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donor and acceptor molecuies in 
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MicroFRET system compensates for 
overlap among donor, acceptor and 
FRET spectra using well characterized 
fluorescent beads as standards in 
conjunction with radiomeirically 
calibrated image processing techniques. 
The MicroFRET system also provides 
precisely machined epifluorescence 
cubes (4) to maintain propei image 
registration as the sample is illuminated 
(3) at the donor and acceptor excitation 
wavelengths. Algorithms are 

described that pseudocoloi the 
image to display pixels exhibiting 
radiometrically-corrected fluorescence 
emission from the donor (blue), the 
acceptor (green) and FRET (red). The 
method is demonstrated on samples 
exhibiting FRET between genetically 
engineered derivatives of the Green 
Fluorescent Protein (GFP) bound to 
the surface of Ni chelating beads by 
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CALIBRATION OF FLUORESCENCE RESONANCE 
ENERGY TRANSFER IN MICROSCOPY 

STATEMENT AS TO FEDERALLY SPONSORED RESEARCH 

This invention was made at least in part with funds from the Federal Government, 
Department of Energy. The Government may have certain rights in the invention. 

CLAIM OF PRIORITY 

This application claims priority under 35 USC §1 19(e) to U.S. Patent Application 
Serial No. 60/048,696, filed June 5, 1997, and to U.S. Patent Application Serial No. 
60/057,931, filed September 4, 1997. 

TECHNICAL FIELD 

This invention relates generally to fluorescence resonance energy transfer (FRET), 
and more particularly to calibration standards for FRET. 

BACKGROUND 

Fluorescence resonance energy transfer (FRET) is a non-radiative process whereby 
energy from a fluorescent donor molecule is transferred to an acceptor molecule without the 
involvement of a photon. Excitation of the donor molecule enhances the fluorescence 
emission of the longer-wavelength acceptor molecule (i.e., sensitized acceptor emission). The 
quantum yield of the donor fluorescence emission is concomitantly diminished. FRET has 
become a valuable tool for microscopy, because the efficiency of energy transfer has a strong 
inverse dependence on the distance between the donor and acceptor molecules. Thus, the 
appearance of FRET is a highly specific indicator of the proximity of the two molecules. This 
has led to the use of FRET efficiency as a "spectroscopic ruler" to measure molecular 
distances. 

A typical FRET experiment for observing cells involves specifically labeling 
particular molecules with fluorescent dyes and detecting these dyes over selected excitation 
and emission wavelength ranges. These wavelength ranges are commonly referred to as 
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"channels" for a particular fluorophore. Fluorescent labeling is easier to accomplish for 
extracellular molecules than for intracellular ones. For intracellular molecules, the dye- 
conjugated molecules must be either injected into the cell for observation or the labeled 
molecules may be overlaid onto a thin section of fixed, permeabilized tissue. Recently, 
5 however, the availability of green fluorescent protein (GFP) mutants with shifted excitation 
and emission spectra has made it feasible to measure protein-protein interactions by using 
GFP tags as intracellular markers. GFP-tagged protein chimeras are expressed intracellularly 
and do not require any chemical treatment to become fluorescent. FRET can also occur 
between fusions of blue-emitting and green-emitting GFP variants. 

Although FRET microscopy has the potential to become a widely used analytical tool 
in these systems, accurate steady-state measurement of FRET by standard epifluorescence 
microscopy has been hindered by several limitations, including: 

(1) Bleed-through or spillover of donor (and isolated acceptor) fluorescence emission 
into the FRET channel due to spectral overlap. Compensation for spectral overlap requires 

15 the use of accurate calibration standards to determine the correction factors. 

(2) Image registration. Correcting each pixel in an image for spectral overlap requires 
taking three separate images with each of the three epifluorescence cubes (i.e., donor 
emission, acceptor emission, and sensitized acceptor emission). If the surfaces of all three 
epifluorescence cubes are not exactly parallel, image registration is lost and the resultant 

20 geometric distortion will also have to be corrected. Loss of image registration greatly 

complicates the correction procedure and reduces the overall accuracy of the corrected data. 

(3) Calculation of FRET by sensitized emission has a large uncertainty when the 
FRET efficiency is low. 

(4) Photobleaching of the donor during the measurement results in anomalously low 
25 estimates of FRET in the sample. 

These limitations apply to GFP as well as to other fluorescent FRET pairs. 
Because of recent advances in "chromosome painting," cell biologists are becoming 
familiar with epifluorescence microscopes that utilize multi-bandpass filters to obtain 
information on several dyes simultaneously. Some of these instruments employ interfero- 
30 metry, while others use filter wheels in the excitation path to select specific excitation bands 
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In both cases, an assumption is made that excitation at a given wavelength results in emission 
from the next reddest transmission band. While multiband cubes help to solve the image 
registration problem for separable dyes, fluorescence phenomena which involve large or 
variable Stokes shifts cannot be addressed. Multiband systems cannot be used to detect FRET 

5 because the FRET emission channel is not the next (redder) emission band and is therefore 
indistinguishable from the donor's emission. 

Accordingly, the inventors have determined that a need exists for an improved FRET 
system which provides for close image registration, and minimizes or corrects for low FRET 
efficiency, photobleaching, and spectral overlap. The present invention provides for such a 

10 system. 

SUMMARY 

The invention provides a method for transforming an initial image of biological 
material to a processed image, the initial image being represented by a set of pixels each 

15 having three color space coordinates. The method includes the steps of (a) selecting at least 
two image regions in the initial image, each image region including at least one pixel, 
wherein the image regions define at least two distinguishable spectral categories; (b) 
performing a color space transformation on the initial image, based on the color space 
coordinates of the pixels in each of the selected image regions, to generate a processed image; 

20 and (c) evaluating the processed image for a visible indication of an improved spatial 
distribution of color. 

The invention further provides a quantitative method for color space transforming an 
initial FRET image of biological material to a corrected FRET image, and includes applying 
other image corrections. 

25 The invention also provides a set of calibration targets for FRET. The set of calibra- 

tion targets includes: (a) a pure donor target for binding only to donor molecules; (b) a pure 
acceptor target for binding only to acceptor molecules; and (c) a donor and acceptor target for 
binding to a mixture of donor and acceptor molecules which exhibit FRET. In a specific 
embodiment, the set of calibration targets are genetically engineered derivatives of the Green 
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Fluorescent Protein (GFP) bound to the surface of Ni chelating beads by histidine-tags (His-tags). 

The details of one or more embodiments of the invention are set forth in the accompa- 
nying drawings and the description below; Other features, objects, and advantages of the 
invention will be apparent from the description and drawings, and from the claims. 

5 

DESCRIPTION OF DRAWINGS 

FIG. la is a block diagram showing one embodiment of a FRET imaging microscope 
for acquiring spatially co-registered electronic images suitable for use with the present 
invention. 

10 FIG. lb is a diagram of an epifluorescence filter cube. 

FIG. 2, panel A shows the fluorescence excitation (thin lines) and emission (thick 
lines) spectra of BFP1 1 (blue) and RSGFP4 (green) proteins attached to chelating Sepharose 
beads via their His tags. Panel B is a comparison between the fluorescence emission of the 
BFP1 1 and RSGFP4 FRET pair bound (thick line) and following release (thin line) from 

15 chelating beads. 

FIG. 3 is an output from a MicroFRET graphical user interface, showing three 
monochrome images taken of the bead mixture using the donor, acceptor, and FRET 
epifluorescence cubes described in TABLE L These images have been combined to produce 
an RGB image which does not fully differentiate among the three bead types because of 

20 spectral overlap. Windows: lower right (C,); lower left (C 2 ); upper right (C 5 ); upper left 
(RGB). 

FIG. 4 is an orthonormalization of the color axes for a red-green-blue (RGB) display. 
This color-correction algorithm redefines the color axes from the dotted arrows of a conven- 
tional RGB display (lower left) to the solid axes of the orthonormalized image (upper right). 
25 This process results in the primary colors (red, green, blue) being assigned to the three pixel 
or bead types (FRET, Acceptor, Donor), respectively. Thus, the poorly differentiated colors 
of the raw RGB image shown in FIG. 3 (F, A, and D) are transformed by orthonormalization 
into pure red (F'), green (A'), and blue (D'). 

FIG. 5 shows the spectral overlap correction and orthonormalization of donor, 
30 acceptor, and FRET beads. 
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FIG. 6 shows the surface of the chelating bead, as represented by a horizontal black 
line, with GFP donors and acceptors (e.g., BFP and RSGFP) shown as blue and green vertical 
lines, respectively. Six different types of possible interactions are labeled A-F. In this 
drawing, only adjacent molecules are considered to be within an efficient FRET distance. 

FIG. 7 is a set of spatially coregistered color-coded images which show Baculovirus- 
infected Sf9 cells expressing a blue-emitting derivative of GFP (i.e., BFP1 1), a ereen- 
emitting derivative with red-shifted excitation (i.e., RSGFP4), and a BFP1 1/RSGFP4 fusion 
protein that is efficient at FRET. The donor, acceptor, and FRET signals have been separated 
and pseudocolored blue, green, and red, respectively, by the qualitative MicroFRET imaging 
system based on picking candidate D, A, and F pixels. 

FIG. 8, panel A shows the fluorescence excitation (thin lines) and emission (thick 
lines) spectra of a blue (BFP1 1) and a green (RSGFP4) GFP derivative chelated to Ni/NTA 
Sepharose beads via the proteins' His-tags. These spectra are virtually indistinguishable from 
those of the corresponding purified proteins in solution. Panel B is a comparison between the 
fluorescence emission (with excitation at the donor's wavelength, 370 nm) of the 
BFP1 1 /RSGFP 4 FRET pair bound to the bead (thick line) and following release (thin line) by 
treatment with imidazole. The spectra shown in FIG. 8 confirm that the fluorescence 
emission from the FRET Bead is due to energy transfer, and that the spectral properties of the 
two GFP variants have not changed as a result of binding to the Ni/NTA Sepharose beads. 

FIG. 9 shows hematoxylin and eosin (H&E) slides of stained thin sections of cardiac 
tissue including an infarct. The left panel shows the true-color image generated by combining 
three separate monochrome images at 450, 550, and 650 nm of the H&E stained tissue. The 
right panel shows this image after orthonormalization in accordance with the invention. 
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DETAILED DESCRIPTION 

Overview 

The invention provides a new system for FRET imaging microscopy, based on 
epifluorescence microscopy. In a preferred embodiment known as the MicroFRET system, 
5 precisely machined epifluorescence cubes are used to maintain proper image registration in 
order to allow correction for spectral overlap. The MicroFRET system also utilizes fluores- 
cent protein standards which are reversibly bound to high-performance Sepharose beads. 

In addition, newly designed software is capable of displaying processed pixel images 
of donor, acceptor, and FRET pixel information. Calibration parameters obtained from 

10 tagged beads can be applied to other images where the conditions under which the images are 
acquired are identical. This new design also makes it feasible to detect relatively small 
amounts of FRET within a given pixel, because the mathematical correction is much simpler 
(and therefore more accurate) than was previously possible. 

Steady-state FRET imaging of cells by sensitized emission, using conventional 

15 microscopy, has previously suffered from an inability to correct for spectral overlap while 

maintaining spatial accuracy. Until now, the three epifluorescence cubes (donor, acceptor and 
FRET) that must be used to generate the correction values have been manufactured with 
optical surfaces that are not strictly parallel. This defect created geometric distortions in the 
image {i.e., displacement of pixels) after the images were combined. The invention utilizes 

20 epifluorescence cubes which have been machined to precise tolerances, so that spatial co- 
registration is maintained for all of the images. The invention also provides beads that are 
useful as calibration standards, so that spectral overlap can be corrected and features can be 
identified within the image that display donor emission, acceptor emission, and donor- 
sensitized acceptor emission (FRET). By subsequently applying an orthonormalization 

25 algorithm ("pixel purification"), the pure donor, pure acceptor, and FRET beads are pro- 
cessed as blue, green, and red, respectively. The processing is useful to cell biologists who 
seek to determine the spatial distribution of each of the three fluorescent components. 

Another concern with sensitized emission using conventional microscopy has been 
that the exciting light can photobleach the donor, thereby reducing the apparent intensity of 
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the FRET signal. However, by utilizing a high sensitivity camera, the sensitized emission 
technique of the invention does not reduce the FRET signal by more than about 5%. 

The invention provides quantitative FRET technology in 3-dimensional imaging 
systems such as confocal microscopes. Potential applications of quantitative FRET micros- 
5 copy are almost innumerable and span several disciplines in biology, from basic mechanistic 
aspects of cell biology to the discovery of new pharmaceuticals. 

The device of the invention and improved methods for FRET microscopy will 
facilitate cell biology experiments involving tagged proteins (e.g., protein-protein interac- 
tions) as well as drug discovery (protein-small molecule interactions), where there is a need 
10 to quantitate the extent to which two molecules are interacting. 

The invention includes bead standards applicable to 3-D imaging, as well as software 
that calibrates volume elements. 

Unless otherwise defined, all technical and scientific terms used herein have the same 
meaning as commonly understood by one of ordinary skill in the art to which this invention 
15 belongs. Although methods and materials similar or equivalent to those described herein can 
be used in the practice or testing of the present invention, suitable methods and materials are 
described below. 

All publications, patent applications, patents, and other references mentioned herein 
are incorporated by reference in their entirety. In case of conflict, the present application, 
20 including definitions, will control. In addition, the materials and methods described herein 
are illustrative only and not intended to be limiting. Other features and advantages of the 
invention will be apparent from the following detailed description, the drawings, and from 
the claims. 

25 Optical Instrumentation 

The methods of the invention use an optical device that acquires spatially co-regis- 
tered electronic images. For example, the optical instrument can be a microscope and digital 
camera. The microscope can be a steady-state, wavelength-scanning fluorescence microscope 
(i.e., not a time-resolved system or not an interferometer-based system). The optical instru- 

30 ment can also provide for background subtraction, spectral overlap corrections, and transfor- 
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mation of data from three channels set into a color space defined by the primary colors of red. 
green, and blue. The transformation of data produces an enhanced image in which FRET, 
acceptor, and donor pixels are more clearly differentiated and pseudocolored accordingly. 

FIG. la is a biock diagram showing one embodiment of a FRET imaging microscope 
5 for acquiring spatially co-registered electronic images suitable for use with the present 

invention. The structure includes a microscope 1, a detection camera 2, a light source 3, a set 
of three interchangeable epifluorescence cubes 4 (donor, acceptor, and FRET), an image 
processor 5, and an image output device 6. 

In a specific embodiment, the MicroFRET instrument is based on an Olympus BX60 

10 (upright) or 1X70 (inverted) epifluorescence microscope 1 . The detection camera 2 uses a 

KAIROS Peltier-cooled charge-coupled device (CCD) camera (Model K7: 16 bit, 760 * 510 
resolution, or Model K8: 16 bit. 1340 x 1037 resolution) coupled to the trinocular port of the 
microscope 1. The detection camera 2 coupling to the microscope is made through a c-mount 
to Olympus U-PMTVC and Olympus U-SPT relay tubes (containing a 2.5 x projection 

15 eyepiece). The threaded U-PMTVC mount can be adjusted to make the detection camera 2 
parfocal with the oculars. Other hardware components used in this study include a 1 OX/0.40 
objective (U-plan apo infinity/0. 17). 

The light source 3 for excitation illumination can be provided by a 75 watt quartz 
tungsten halogen (QTH) light source coupled directly to the microscope 1, although other 

20 light sources may be used if desired. Exposure time is controlled by an electronic shutter in 
the detection camera 2. Typical exposure times are 0.15-2 seconds. The use of low light 
doses in imagery was enabled by minimizing exposure time and intensity, using extremely 
sensitive CCD cameras, and by carefully selecting epifluorescence cubes 4 with broad band 
emission filters and narrow band excitation filters. Spectral deconvolution algorithms readily 

25 correct for the broad-band emission filters. 

FIG. lb is a diagram of an epifluorescence filter cube 4. Each epifluorescence cube 4 
includes an excitation filter 10, an emission filter 1 1, and a dichroic mirror 12. The excitation 
filter 10 is a band pass or high pass filter that allows only short wavelength light from a light 
source to pass through. The emission filter 1 1 is a band pass or low pass filter that passes 

30 only long wavelength light emitted by the object in response to illumination by the shorter 
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wavelength exciting light. The dichroic mirror 12 is a beam splitter that reflects the exciting 
light onto the object and then allows emitted light from the object to pass through. The "cut 
on 11 wavelength of the dichroic mirror 12 generally lies between the transmission bands of the 
excitation filter 10 and the emission filter 1 1 in a simple configuration. 

The methods of the invention use epifluorescence cubes 4 which have been machined 
to precise tolerances, so that spatial co-registration is maintained for all of the images. This 
design also makes it feasible to detect relatively small amounts of FRET within a given 
image pixel, because the mathematical correction is much simpler (and therefore more 
accurate) than was previously possible. The epifluorescence cubes 4 are precisely milled and 
fabricated, such that there is less than 5 arc seconds deviation between the two planar 
surfaces of each of the dichroic mirrors and emission filters in the epifluorescence cubes. 
This low deviation between the two planar surfaces of each of the dichroic mirrors and 
emission filters results in a high degree of image registration. Because image registration and 
distortion are highly dependent on exact surface parallelism within the dichroic and emission 
filters' surfaces, the dichroic and emission filters of all three cubes were measured for surface 
parallelism (using an autocollimator) and for surface flatness (using an interferometer) and 
found to be less than or equal to 15 arc seconds of wedge parallelism and approximately 10 
waves flatness. Epifluorescence cubes having suitable characteristics were manufactured by 
Chroma Inc. (Brattleboro, VT) to the specifications of less than 2 waves flatness and 5 arc 
seconds wedge. Lesser quality epifluorescence cubes can be corrected by optical centering 
adjustment (OCA) devices (from Olympus of Huntington, NY) in conjunction with donor 
(D), acceptor (A), and FRET (F) cubes to co-align images in run time using a 
focusing/alignment acquisition loop implemented in software. The target can be a fluorescent 
bead (size = point source) visible in all three channels and aligned to one pixel in co-registra- 
tion among the three channels. This is a novel use of OCA's for FRET. Preferred epifluore- 
scence cube specifications are described in TABLE L 
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TABLE 1 

Spectral characteristics of epi fluorescence cubes. Wavelengths (run) arc 
given as cut-on and cut-off (50% peak transmission) for excitation and 
emission filters, and as the inflection point for dichroic filters 


Cube/Channel 


Excitation 


Dichroic 


Emission 


Donor/C, 


335 - 380 


410 


435 - 490 


Acceptor/C-, 


450 - 490 


495 


505 - 550 


FRET/C, 


335 - 380 


410 


505 - 720 



10 



20 



25 



30 



The C, channel (arbitrarily assigned to Blue) was designed to selectively excite and 
image donor (D) emission, the C 2 channel (arbitrarily assigned to Green) was designed to 
selectively excite and image acceptor (A) emission, and the C 3 channel (arbitrarily assigned 
to Red) was designed to visualize FRET (F) emission, since excitation was at the donor 
excitation and imaged at the acceptor emission. 

Conventional epifluorescence cubes may be replaced by Fluorescence Imaging 
Micro-Spectrophotometer (FIMS) technology or other methods which do not use a set of 
three fixed-wavelength devices. In FIMS, the emission filter is continuously variable and the 
excitation wavelength can be selected by another device, such as a monochromator. A 
description of the FIMS technology is set forth U.S. Patent Application No. 08/833,351, filed 
2/10/98, entitled "Optical Instrument Having a Variable Optical Filter", and assigned to the 
assignee of the present invention. 

The image processor 5 may be a suitably programmed personal computer. The image 
output device 6 may be a computer monitor (e.g., CRT or LCD display) or a printer. In 
operation, a monochrome image of an illuminated sample is taken by the detection camera 2 
through the microscope 1 and input into the processor 5 as a digitized pixel image. A set of 
three such images from each channel (donor, acceptor, and FRET) can then be processed as 
three spatially coregistered images or treated as a single image in which each pixel has three 
color space coordinates corresponding to the monochrome wavelengths. 

The method of the invention is not limited to an epifluorescence microscope. 
Macroscopic lens-based systems could be used in place of the microscope's objectives to 
achieve FRET detection and quantitation over a macroscopic field of view, such as a 
microliter tray or petri dish (in biology), or a solid state device (in materials science). 
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FRET Physics 

The Forster equations, which are the basic equations describing FRET, involve 
expressions for the energy transfer rate constant (kj, the transfer efficiency (E), the so-called 
Forster radius or critical distance (R 0 , in cm), the spectral overlap integral (J (X)) and the 
5 normalized fluorescence emission spectrum of the donor (f (A.)): 

k t = (R 0 /r) 6 (l/T d ) 
E = [l +(r/R 0 )V 
R, = [8.79 x 10- 25 J(X)K 2 Q D n 4 ] 1/6 
10 J(^H/We A a)A 4 dA 

f(X) = F D (X)dX /\F D (X)dX 

r is the center-to-center distance (in cm) benveen the donor and acceptor chromo- 
phores, x d is the fluorescence lifetime of the donor in the absence of energy transfer, k : is the 

15 dipole-dipole orientation factor, Q D is the fluorescence quantum yield of the donor in the 
absence of the acceptor, n is the refractive index of the intervening medium, F D (X) is the 
fluorescence emission intensity of the donor at a given wavelength X (in cm), and e A (A) is the 
extinction coefficient of the acceptor chromophore (in cnr'M"*). J(A.) therefore expresses the 
normalized fluorescence spectrum of the donor and has units of M 'cm 3 . 

20 For randomly oriented molecules separated by a distance r 5 when r = R Qy the effi- 

ciency of energy transfer is 50%, and the donor fluorescence lifetime is reduced by a factor of 
2. Values of R 0 are on the order of tens of Angstroms. FRET efficiencies fall-off at an inverse 
6 th power of distance as normalized by R Q . Doubling the distance between donor and acceptor 
molecules from R 0 to 2R 0 decreases the FRET efficiency from 50% to approximately 1% 

25 because of the inverse-6 ,h power dependence: (0.5) 6 . Thus, FRET is a very useful tool for 

determining whether two molecules are in close proximity. This is especially true in the case 
of interacting macromolecules, where molecular radii are similar in size to the actual R 0 
values of their fluorescent tags. 

The extent to which the donor emission is quenched by the acceptor can be used to 

30 calculate the FRET efficiency E according to one of Forster's equations: 
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£ - 7 o~ 7 ^ (6) 



where I D and I DA are the fluorescence intensity of the donor in the absence and 
presence of acceptor, respectively. This is equivalent to determining the concentration of 
donors performing FRET, divided by the total concentration of donors. 

For most cell biologists, a useful measurement is the relationship of E to r within a 
color-coded image. The invention provides simple models to convert E to the donor-acceptor 
distance (r). 

Correcting Spectral Overlap 

In one embodiment, the inventive method corrects for spectral overlap between the 
donor and acceptor channels (selected excitation and emission wavelength ranges, see supra) 
The mathematical basis for the spectral overlap corrections is provided as follows: 

(7) 

where X can be substituted by «D", "A", or "F" to indicate an image pixel from one of 
the monochrome fluorescence images acquired through the Donor, Acceptor or FRET 
channels, respectively. The subscript "u", can be substituted by "d", "a" or "f ' to represent a 
pixel from either a donor, acceptor or FRET bead in the image. Since there is substantial 
spectral overlap, more than one bead type can be seen in each unprocessed channel (FIG. 3). 
The superscript "y", in the equations (8) and (9) below, is replaced by "b" to indicate that the 
monochrome image has been background subtracted before spectral overlap corrections are 
performed. 



pilots 



ratio of FRET channel intensity to Donor channel intensity for a "pure 
donor" pixel after background subtraction on each monochrome 
image. (g) 



ratio of FRET channel intensity to Acceptor channel intensity for a 
"pure acceptor" pixel after background subtraction on each mono- 
chrome image. ^ 
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These ratios are the fractional "bleed' 1 or spectral overlap of donor and acceptor, 
respectively, into the FRET channel. They are then used to conect the FRET channel pixel 
intensities. Each pixel in the corrected FRET channel image (F r ) is given by: 

F' = F" -(Ft/D*)* D b -(F„V^)x A" (1Q) 

5 

After background and spectral overlap corrected monochrome images are obtained for 
each channel, the three images are combined into a composite RGB image to create a 
corrected FRET image. In the illustrated embodiment, the donor channel is not corrected for 
acceptor bleed and the acceptor channel is not corrected for donor bleed because these effects 
10 are minimal. 

The con-ection for spectral overlap is performed as follows: The ratio of the FRET 
channel intensity to the donor channel intensity is determined for a "pure donor" pixel after 
background correction. The ratio of the FRET channel intensity to the acceptor channel 
intensity is also determined for a "pure acceptor 1 ' pixel after background correction. These 
15 ratios are then used to correct the FRET channel values for each pixel. 

Orthonormalization 

In one embodiment, the method uses orthonormalization to convert donor, acceptor, 
and FRET signals into unique colors. For example, the donor, acceptor, and FRET signals are 

20 converted to B(lue), G(reen), and R(ed). An orthonormalization procedure which qualita- 
tively enhances the corrected image is described below. 

In addition to the spectral overlap algorithm given above, the image can be further 
enhanced by the construction of RGB images based on an orthonormalization transformation. 
This process results in the FRET, acceptor, and donor pixels being pseudocolored by pure 

25 primary colors: red, green, and blue respectively. To do this, selected pixel values from each 
of the previously processed monochrome images can be used to construct a 3 * 3 matrix, 
referred to as the A matrix: 
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Monochrome Image 
(Grayvalue Image) 



Selected Pixel 



f 
a 
d 



F 


A 


D 




A„ 


A l2 


A„ 




A 21 


A 22 


A 23 




A 3 , 


A 32 


A 33 





= [A] 



(11) 



Columns in [A] represent the three previously processed monochrome images and 
rows represent selected pixels. For example, A,, is equal to a pixel value in the FRET image 
which corresponds to the location of a FRET bead. A 12 and A l3 are equal to the pixel value in 
the acceptor and donor images, respectively, at this same position. 

The goal of the orthonormalization operation is to transform the A matrix into the 
following matrix: 

Monochrome Image 
(Grayvalue Image) 



Selected Pixel 



f 
a 
d 



F 


A 


D 




c„ 


0 


0 




0 


c 22 


0 




0 


0 


C33 





(12) 



Where C u , C 22 and C 33 are set to the maximum possible pixel value. The transforma- 
tion can be expressed as follows: 

[A][B] = [C] (13) 
Knowing [A] and [C], the B matrix can be determined by multiplying both sides of 
the equation (13) by the inverse of A: 

[A]" I [A][B]^[B] = [A]- 1 [C] (14) 
The A matrix can be inverted, provided that the selected pixels define independent 
axes. Once the B matrix has been determined, each RGB pixel value triad is multiplied by the 
B matrix to determine the new triad. The transformation may cause some grayvalues to be 
negative, so their absolute value is always used. The transformation may also cause gray- 
values to exceed their maximum possible value. Accordingly, all of the new grayvalues are 
scaled so that the maximum gray value in the RGB image is equal to the maximum possible 
grayvalue. This completes the purification process. 
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]n terms of process steps, orthonormalization may be performed by; 

(1) Selecting at least two image regions in an initial image, each image region 
including at least one pixel, wherein the image regions define at least two distinguishable 
spectral categories. 

5 (2) Performing a color space transformation such as orthonormalization on the initial 

image, based on the color space coordinates of the pixels in each of the selected image 
regions, to generate a processed image. (If desired, orthonormalization may be performed 
serially on a dynamic series of initial images, or a series oi acquired digitized images can ali 
be corrected simultaneously). 

10 (3) Evaluating the processed image for a visible indication of an improved spatial 

distribution of color. The step of evaluating may be based on the improved spatial distribu- 
tion of colors properly segregating to known standard targets, or the improved spatial 
distribution of colors segregating to biological structures. Preferably, a confocal microscope 
is used to perform such evaluation in order to observe three-dimensional spatial information. 

15 The orthonormalization step is useful to cell biologists who may reiteratively seleci 

candidate pixels as representatives of the donor, acceptor, and FRET. This human interven 
tion could be a key component in extracting data from images: the quality of the pixel 
selection would be evaluated by the resulting morphology of the pseudocolored image. Foi 
example, if FRET is observed within a particular structure after the spectral overlap correc 

20 tion, it might be advantageous to test various pixels within this structure by re-selecting 
candidate "red" pixels. 

These algorithmic methods (whether involving imaging or not) may be adaptable to 
flow cytometry (including imaging-in-flow methods) or sorting of cells in a flow system. 

25 Quantitative FRET Measurements 

In one embodiment, the quantitative method of the invention performs quantitative 
FRET measurements and analyses. FRET image data is obtained with standard filter sets in a 
fluorescence microscope. One set of equations for quantitative FRET is provided below 
(equations 15a-30). These equations are similar to or derived from FRET correction equa- 

30 tions set forth in Gordon, et ai, Quantitative Fluorescence Resonance Energy Transfer 
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Measurements Using Fluorescence Microscopy, Biophysical Journal, Vol. 74, May 1998 
2702:2713, which is hereby incorporated by reference. The two and three letter symbols used 
in the equations havethe following meanings: 

Aa is the signal from an acceptor-only specimen using the acceptor filter set; 

Dd is the signal from a donor-only specimen using the donor filter set; 

Fa is the signal from an acceptor-only specimen using the FRET filter set; 

Fd is the signal from the donor-only specimen using the FRET filter set; 

Ad is the signal from a donor-only specimen using the acceptor filter set; 

Da is the signal from an acceptor-only specimen using the donor filter set; 

Df\s the signal from an 'acceptor plus donor' specimen using the donor filter set; 

Ff\s the signal from the 'acceptor plus donor' specimen using the FRET filter set; 

Af is the signal from an 'acceptor plus donor' specimen using the acceptor filter set; 

Dfd refers to only the donor signal with the Donor filter set when both donor and 
acceptor are present; 

Dfa refers to only the acceptor signal with the Donor filter set when both donor and 
acceptor are present; 

Ffd refers to only the donor signal with the FRET filter set when both donor and 
acceptor are present; 

Ffa refers to only the acceptor signal with the FRET filter set when both donor and 
acceptor are present; 

Afd refers to only the donor signal with the Acceptor filter set when both donor and 
acceptor are present; 

Afa refers to only the acceptor signal with the Acceptor filter set when both donor and 
acceptor are present; 

Dfd refers to the donor signal with the Donor filter set that would have been if no 
acceptor were present and therefore no FRET occurred; 

Afa refers to the acceptor signal with the Acceptor filter set that would have been if 
no donor were present and therefore no FRET occurred. 

The FRET symbols used in the following equations have the following meanings: 
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FRET1 is the loss of donor signal due to FRET using Donor filter set in the method 
using three-filter sets; 

FRETN is the normalized measure of FRET equal to FRETl/{Df d x A fa); 
FRET2 is equal to FRET1/Dfd~\ 

FRET3 is equal to FRETl/{DflT* Afa), which equals FR£TN\ 
FRET4 is the loss of donor signal due to FRET using Donor filter set in the method 
using two-filter sets; 

G is the factor relating the loss of donor emission due to FRET in the Donor filter set 
to the gain of acceptor emission due to FRET in the FRET filter set. 

Note that in a two-filter system, the following substitutions may be made: 
Dd 9 is similar to Dd but with acceptor concentration proportional to donor concentra- 
tion; 

Fd' is similar to Fd but with acceptor concentration proportional to donor concentra- 
tion; 

Ad' is similar to Ad but with acceptor concentration proportional to donor concentra- 
tion; 

Da ' is similar to Da but with acceptor concentration proportional to donor concentra- 
tion; 

Fa 9 is similar to Fa but with acceptor concentration proportional to donor concentra- 
tion; 

Aa ' is similar to Aa but with acceptor concentration proportional to donor concentra- 
tion. 

Additional corrections for F c can be derived from equations 15a-30 below, where 
equation (10) is rewritten in the terms defined above as equation (15): 

F c = Ff - Df(Fd/Dd) - AffFa/Aa) (15) 

In particular, P can be (1) corrected for cross-talk resulting from detection of donor 
fluorescence through an acceptor emission channel and/or acceptor fluorescence through a 
donor emission channel (e.g., corrected for non-zero values of Ad and Da); (2) normalized for 

# 

-17- 



9855026A1 I > 



WO 98/55026 



PCT/US98/11390 



the concentranon of a donor, preferably by applying a correction of \IDf; (3) normalized for 
the concentration of an acceptor, preferably by applying a correction of MAf, (4) normalized 
for the concentration of a donor and an acceptor, preferably by applying a correction of 
IKDjXA,); (5) corrected for cross-talk and normalized. In addition, the initial FRET image is 
improved with respect to photobleaching by using a sensitive camera and fast exposure times. 
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Df = Dfd + Dfa (15a) 

Ff = Ffd + Ffa (15b) 

Af = A/d + Afa (15c ) 

Df = Dfd + Ffa{Da I Fa) (16a) 

Ff = Dfd{Fd I Dd)+ Ffa (16b) 

4/" = Z)/rf(^rf / ZM) + A/a (1 6c) 

Dfd = D~jd - FRETX (17 ) 

Afa = ~AJa' + G ■ FRET\{Ad I Fd) (18a) 
0n 7"r 



c = 



(18b) 



0^ & J D 

Ffa = ~Afh(Fal Aa)+G-FRET\ (19) 
Dfa = A~fa{DalAa)+G-FRET\{DalFa) (20) 



£>/ = - F££71 + Afa(Da/Aa)+G - FRET\{Da / Fa) (21a) 

Ff = (D/d- FRET\\Fd I Dd) + Afa{Fa IAa)+G- FRET] (21b) 

Af = {5/d - FRET\\Ad /Dd)+A/a + G- FRET\{Ad I Fd) (21c) 
— Af-{AdlFd)Ff 

Afa = X-{Fa,Aa\Ad,Fd) < 22a > 

F M Tl ^Ff-{FdlDd)Df-A7a[{FalAa)-{FdlDdXDalAa)} 

G[\-{DalFa\FdlDd)] (22b) 

DJd = Df + FRET\{\ - G{Da I Aa)]- AJh(Da I Aa) (22c) 
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FRETl [bound] 

FRETN = oc 1 J , 2 o\ 

• A/a [total d] ■ [total a) 

K c = [bound]/ {[free d\ [free a]) (24) 

FRETN- Pf-^IDd)-A/{FalAa) 

G-Df-Af kZ0) 



Df = D/d - Dfd ■ FRETl + Afa{Da IAa)+G-Dfd- FRET2(Da I Fa) (26a) 

Ff = {5fd -Dfd ■ FRETl^Fd I Dd)+Afa{Fal Aa)+ G -Dfd ■ FRETl (26b) 

A/ = (Dfd -Dfd- FRETl\Ad I Dd)+Afa + G Dfd ■ FRETl{Ad I Fd) (26c) 

— _ Af-(Ad/Fd)Ff 

J ~ \-[{AdlFd\FalAa)] < 27a ) 

FRET2 = ff ~ {Fd I Dd)Df - Afa[{Fa IAa)-{Fdl Dd\Da I Aa)] 

f/[\ - {Da I Fa)G] - D/[{Fd I Dd)-G] (27b) 

- Afh[{Fa I Aa) - {Fd I Dd\Da I Aa)] 

FRETN = FRETl I Afa (28 ) 



Df = D/d - D/d • A/a ■ FRET3 + A/a{Da I Aa)+ G -Dfa -Afa ■ FRET3{Da I Fa) (29a) 

F/ = (Dfd -Dfd Afa- FR£T2\Fd I Dd) + Afa{Fa I Aa) + G -Dfd -A/a ■ FRET3 (29b) 

A/ = {5fd - Dfd ■ Afh-FRET3\Ad I Dd) + ~Afa + G ■ Dfd ■ ~Afa ■ FRET3(Ad I Fd) (29c) 

FRETN = FRET3 = FRETl I Afa = FRETl /(bfa ■ Afa) (30) 
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FRFT Beads as Calibration Standards 

Tht invention provides a set of calibration targets, including a variety of "FRET 
Beads" applicable to widely-used FRET pairs. The invention also provides a method for 
imaging the FRET standards in a conventional three-channel {i.e., three-cube) epifluore- 
scence microscope, and applying FRET calibration algorithms such that donor concentration 
[D], acceptor concentration [A], and FRET efficiency (E) values can be determined on 
unknown samples. An advantage of using surfaces such as beads as FRET calibrants, rather 
than solution-based techniques, is that the use of surfaces such as beads eliminates unwanted 
interference by various physico-chemical phenomena, such as singlet-singlet annihilation. 
Other effens may accentuate FRET on surfaces as excitons are formed. 

In one embodiment, the invention provides FRET Beads with His-tagged GFP 
derivatives to Ni/NTA derivatized Sepharose beads at a surface concentration that is 
sufficiently high to achieve efficient FRET between donor and acceptor molecules, e.g., 
between blue-emitting (BFP) and green-emitting GFP derivatives. These FRET Beads 
provide a surface to associate (bind) these His-tagged proteins very tightly in aqueous 
solution (stable for months at 4 °C); however, protein dissociation and release from the bead 
can be accomplished immediately by the addition of imidazole. Release from the bead 
modulates the FRET properties of donor and acceptor molecules (i.e., FRET efficiency goes 
to zero). This treatment can be performed in the same fluorimeter cuvette; the difference in 
spectra taken before and after release is a direct indication of FRET efficiency. Previously, 
FRET parameters were extremely difficult to obtain; for example, artifacts can be generated 
by alternative procedures such as loading highly concentrated donor and acceptor solutions 
into microc apillaries. The invention of a FRET Bead with selective release makes these 
parameters trivial to measure. The simple procedure of adding 1 M imidazole enables 
accurate determination of donor and acceptor concentrations and efficiency, thereby furnish- 
ing the basis for calibration standards in quantitative FRET microscopy. These calibrated 
beads are used to determine instrument response and to standardize the epifluorescence 
microscope hardware and software for use with a variety of samples. 

In one embodiment, the invention provides a series of FRET Beads bearing deriva- 
tives of the Green Fluorescent Protein that are of current interest to cell biology. These 



-21- 



WO 98/SS026 



PCT/US98/1I390 



10 



15 



20 



25 



include a blue/green pair (380 nm excitation/510 nm emission) and a cyanTyellow" pair (450 
run excitation/530 nm emission). 

Two derivatives of GFP are used for FRET standards, based on their spectral 
properties. The mutant BFP1 1 , constructed by Lossau et al. (Chem. Physics. 213:1-16, 1996) 
using combinatorial mutagenesis, contains the mutations F64M/Y66H. BFP1 1 has blue- 
shifted excitation and emission maxima relative to wild-type GFP (Figure 2). The mutant 
RSGFP4 (Delagrave et al. Bio/Technology, 13:151-154, 1995), generated by combinatorial 
mutagenesis, contains the mutations F64M/S65G/Q69L. RSGFP4 has spectral properties 
similar to the S65T mutant leported by Heim et al. (Proc. Natl. Acad. Sci. USA 91 .12501- 
12504, 1 994). As the acceptor in a FRET pair, both S65T and RSGFP4 are superior to other 
red-shifted excitation mutants such as RSGFP8 (F64L + S65T), because the latter mutant has 
significant excitation in the violet. 

Calibration values can be stored on a computer for future normalization and correc- 
tion of samples that do not include calibration standards (/.*. pure donor, acceptor, or FRET 
Beads) in the same field of view. Once calibrated for a particular pair of fluorophores 
matched to a specific set of cubes within a defined optical bench, these normalization factors 
are stable and applicable to unknowns containing these fluorophores. 

FRET Beads provide a vehicle enabling one to relate a measured intensity of acceptor 
fluorescence sensitization to a corresponding amount of donor quenching. This calibration 
factor, X F , embodies not only instrument response but also the concept of a FRET quantum 
yield. X r greatly simplifies the determination of the amount of donor performing FRET 
without the need to photodestruct or otherwise physically separate donor from acceptor. This 
calibration factor also compensates for differences in absorption cross-sections, excitation 
intensities, and detection efficiencies. 

By combining the £ value determined by conventional fluorimetry measurements of £ 
and quantitative imaging, X F is derived from a FRET calibration bead- 

(34) 

where C, is the intensity from the C, channel and C,' is the intensity from the C 3 
FRET channel after spectral overlap corrections have been made using equation (38), below. 
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This value can then be applied to the calculation of FRET parameters in sample unknowns. 
From equation (6), E is equivalent to determining the number of donors performing FRET, 
divided by the total number of donors. Since the Forster equations apply to a single donor- 
acceptor pair, the amount of donors performing FRET can be directly related to the measured 
sensitized acceptor emission. In the three-cube microscope system, E of FRET samples can 
be determined by incorporating the bead calibration factors (X D and X F ) and combining the C l 
and C 3 channel information as: 

E= H > 



H > +H > (35) 



X X 
where F and D respectively. 

10 Thus equations (34) and (35), used in conjunction with FRET Beads, greatly facilitate 

the conversion of sensitized acceptor emission into units compatible with quenched donor 
emission, resulting in the ability to readily quantitate the amount of donor performing FRET, 
the total amount of donor, and the FRET efficiency. 

For the beads shown in FIG. 8, from the y-axis values, I D = 0.63 and I DA = 0.24. The 

15 energy transfer efficiency E is determined by substituting into equation (6): 

E = 0.63 -0.24 = 0.62 (Le„ 62% efficient in energy transfer) 
0.63 

Measurement of £ enables the mean separation distance (r) between donor and 
acceptor to be calculated using another one of the Forster equations: 

r = * 0 (I^)"« 

20 E (36 ) 

where is the Forster radius or critical distance at which the efficiency of energy 
transfer is 50%. R^can be determined using semiempirical methods and the following {see, 
equation (3)): 

R 0 = [8.79 x lO* 25 J(A)K 2 Q D nT 6 (37) 

25 
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Parameters in equation (37) include J, the spectral overlap integral, which is graphi- 
cally equivalent to the integrated area shared between the donor's fluorescence emission 
spectrum and the acceptor's ground state absorption spectrum, both normalized to unity. 
Other parameters include: Q D , the fluorescence quantum yield of the donor in the absence of 

5 acceptor; «, the index of refraction, which for a cellular system is typically (1.3 - 1.4); k 2 , the 
dipole-dipole orientation factor. Considering the spectral overlap for the BFP1 1/RSGFP4 pair 
shown in FIG. 8 S and random orientation factors, R^is approximately 40 A. Substitution of 
and E into equation (36) results in a separation distance r of 37 A between BFP1 1 and 
RSGFP4 on the FRET Beads described above. This BFP1 1-RSGFP4 distance is reasonable 

10 considering that the minimum possible distance berween the fluorophores is -25 A, as 
indicated by the X-ray structure of the GFP dimei. 

The invention also provides a method to characterize (by conventional fluorimetry) a 
series of beads with controlled quantities of donor and acceptor molecules per unit surface 
area so as to generate standards with respect to donor concentration [D], acceptor concentra- 

15 tion [A], and FRET efficiency (E). The determination of donor intensities in the presence 

(I DA ) and absence (I D ) of FRET, which are normalized for donor concentrations, is one of the 
major difficulties in performing quantitative FRET on biological samples. Imidazole 
mediates the release of the GFP fluorophores from the Ni/NTA-chelating bead to achieve this 
in essentially one step. 

20 The existence of spectral overlap is noted by observing that each of the monochrome 

images shows more than one bead type. In the C ? channel, spectral overlap is a result of 
bleed-through of the donor's emission tail into the acceptor emission band. In addition, direct 
excitation of the acceptor can occur at certain wavelengths (e.g., 370 nm) due to a small 
amount of acceptor absorbance at such wavelengths. Spectral corrections for the C 3 channel 

25 can be made by adapting equation (10) as follows: 

C 3 ' = C 3 - (C 2 D /C X °)*C, - (C//C 2 Vc 2 (38) 

C D IC D 

where 3 1 = the ratio of the FRET channel intensity to the Donor channel 
intensity for a -pure donor" pixel after background subtraction on each monochrome image, 
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C I c 

and 3 2 = the ratio of the FRET channel intensity to the Acceptor channel intensity for a 
"pure acceptor" pixel after background subtraction on each monochrome image. 

Having derived the fluorophore surface concentrations from solution measurements 
(see, equation (40)), donor surface concentrations can be related to the donor emission 
5 intensity in C, images of pure donor beads via the following equation: 

C?~X D [D) (39) 

where X D is defined as the donor calibration factor and has units of grayvalue per 
molecule per unit area. Likewise, the acceptor calibration factor, X A , can be determined from 
pure acceptor beads imaged through the C 2 channel. Since a three dimensional fluorophore- 

10 coated bead is projected onto a two-dimensional imaging surface, care must be taken in 

selecting pixels to be used for intensity (grayscale) measurements. Given the size and optical 
density of these beads, it is reasonable to base intensities on the center pixels of each bead 
and divide by a factor of 2. This is because looking down on a bead in the microscope, 
fluorescence (which is isotropic) is seen from both the bottom and the top of the bead surface 

15 due to the 3D to 2D projection. In determining X A and X D it is important to note that the 

fluorescence quantum yield and instrument response corrections are all embodied within this 
calibration factor. By constructing and characterizing a series of beads, the linearity of this 
relationship or the limits of the linear range are determined. 

By calibrating the instrument, other factors that influence FRET intensity can be 

20 experimentally determined, e.g., the interchromophore separation (r), the orientation factor 
(k 2 ), and the FRET efficiency (E). These calibrations may enable the user to create images in 
which the magnitude and spatial distribution of these coefficients are displayed. Values for 
the first two variables could be determined by adding, for example, corrections for dif- 
ferences in absorption cross section between donor and acceptor, and corrections for 

25 differences in excitation intensity and detector efficiency. Values for k 2 can be determined by 
using calibration standards containing chromophores with fixed orientations. 



-25- 



BNSDOCID: <WO. 



9855026A1_I_> 



WO 98/55026 



PCT/US98/11390 



Calibration and Test Samples 

In a typical analysis, three images using C,, C : . and C 3 are obtained for a calibration 
slide bearing a mixture of pure donor, pure acceptor, and FRET beads. Fluorescent beads are 
air-dried on the surface of a microscope slide for imaging. All images recorded used light- 
minus-dark subtraction to correct for a pedestal of dark counts. The calibration slide is then 
used to obtain the background-subtracted, spectral overlap correction ratios as well as X A , 
X D , and X F . After these measurements are made, this slide is removed and replaced with a 
test sample from which three additional images are obtained under identical experiment 
conditions. Each of these monochrome images is background subtracted and the overlap 
corrections applied. The image-based microscope system performs massively parallel 
analysis on every pixel in the scene. For a 1000 X 1000 resolution image, this is equivalent to 
1 0 6 simultaneous single spot measurements. Each pixel can be processed to generate energy 
transfer efficiency according to equation (35) and distance distribution images according to 
equation (36), provided that R Q is known. [A] images can be determined from the ratio of the 
C 2 channel to X A , and [D] images can also be derived. 

Once the microscope is calibrated for a specific FRET pair, the system remains 
calibrated for all other samples containing those types of fluorophores. Recalibration is 
required only if the microscope's hardware is altered (e.g., changing an epi-cube) or if a 
different FRET pair is studied. 

Quantitation of FRET signals can be achieved by correlating measurements made in 
the MicroFRET device on beads or other targets with conventional measurements made in a 
fiuorimeter. For example, imidazole release of fluorophores from the beads within a cuvette 
can be used to quantify total donor and acceptor, as described in EXAMPLE 2. 

Computer Implementation 

The MicroFRET system provides digital imaging spectroscopy (DIS) software that 
supports algebraic manipulation of images for correcting bleed-through of donor emission 
into the acceptor channel and for correcting excitation of the acceptor at the donor excitation 
wavelength, as well as for creating a new RGB axis-set to highlight donor, acceptor, and 
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FRET pixels. The system also provides image processing and display for both 16-bit 
monochrome images and 24-bit RGB images. 

Correction for spectral overlap was performed as follows: The ratio of the FRET 
channel intensity to the donor channel intensity is determined for a "pure donor * pixel after 

5 background correction. The ratio of the FRET channel intensity to the acceptor channel 

intensity is also determined for a "pure acceptor 1 ' pixel after background correction. These 
ratios are then used to correct the FRET channel values using equation (10) for each pixel. 
After a grayvalue image has been obtained for each of the three channels, the three measure- 
ments are reassembled into a composite RGB image. However, even though the correction 

10 factors for spectral overlap have been calculated for each of the three channels, the various 
donor, acceptor and FRET beads do not necessarily appear as pure blue, green and red, 
respectively, because the colors displayed in the initial RGB image have not yet been 
orthonormalized. MicroFRET allows the user to correct this problem by permitting a user to 
select pixels that contain the most red, green and blue from the overlap-corrected RGB 

15 image. The program mathematically transforms the image to a color system in which the red, 
green and blue axes are defined by the red, green and blue grayvalues for the pixels that have 
been selected (FIG. 4). 

More particularly, the algorithm that is used in MicroFRET transforms an RGB image 
from the red, green and blue color system into a color system defined by three user-defined 

20 RGB triads. A composite RGB image has already been described in FIG. 3, and reproduced 
as panel A in FIG. 5. The FIG. 5 panels are magnified so that only the upper left quadrant of 
the FIG. 3 image is shown. Steps in the bleed correction and the orthonormalization of the 
uncorrected RGB image shown in FIG. 5 (panels A - F) proceed as follows: 

Panel 5 A - RGB. The monochrome images from FIG. 3 were combined to generate 

25 panel 5 A using images shown in windows Dl, Al, and Fl for the blue, green, and red 

channels, respectively. The color intensity range for all three color channels is based on the 
minimum and maximum pixel values of the combined three-image set. 

Panel 5B - Scaling corrections. Fluorescence signal intensities among the three 
channels can vary due to quantum yield and extinction coefficient differences between donor 

30 and acceptor. Signal strength is also dependent on instrument parameters such as illumination 
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intensities of the light source and detector sensitivity at different wavelengths. If the range of 
pixel values differs significantly between channels, the color of the channel with the highest 
pixel value readings can overwhelm the color of the channel with lower pixel value readings. 
Panel 5B shows the pseudocolor image after individually rescaling the color intensity of each 

5 of the three channels to its minimum and maximum pixel values. 

Panel 5C - Background correction. Panel 5C shows the pseudocolor image after each 
pixel has been corrected for background signals. MicroFRET software prompts the user to 
select the position of five background pixels by clicking on the image. These pixel values are 
averaged and automatically subtracted. If any of the subtracted values are negative, thev are 

10 set to zero. 

Panel 5D - Spectral overlap corrections. The data represented in FIG. 3 showed that 
there is significant spectral overlap among the epifluorescence images. However, because the 
epifluorescence cubes in the MicroFRET instrument maintain precise image registration, the 
contaminating contributions to the FRET image (and the other images) can be subtracted 

15 from all of the pixels. For the FRET channel, this correction is performed according to 

equation (l 0) which minimizes donor and acceptor bead pixel values in the FRET channel so 
that they approach zero. Only pixels from beads performing FRET maintain significant signal 
intensity in this channel (red) after correction. Panel 5D shows the pseudocolored image after 
this overlap correction. The "red contribution" from the pure donor and pure acceptor beads 

20 has been removed. The donor beads now appear blue instead of purple and the acceptor beads 
now appear as green. 

Panel 5E - Highlighting FRET. To further demonstrate the correction for spectral 
overlap, the green and blue channels are turned off in the bleed-corrected image. This 
simplifies the identification of the "red" pixels where FRET is taking place. This process is 

25 easily performed in real-time using a simple tabbed dialog box in which each tab allows the 
user to selectively contrast enhance a particular channel. As can be seen in panel 5E, only red 
beads corresponding to FRET are observed. 

Panel 5F. Orthonormalization. To enable identification of areas in the sample which 
contain donor, acceptor, or FRET emission, the software can pseudocolor the image based on 

30 user-defined criteria. By clicking the computer mouse on pixels representing each of the three 
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types of beads (i.e., donor, acceptor, and FRET) in panel 5D, the user can reset the color 
assignments to display corrected emission from the donor to pure blue, the acceptor to pure 
green, and FRET to pure red (panel 5F). 

Computer implementation of this aspect of the invention can be summarized as 
5 follows: 

1 . Select 3 epifluorescence cubes optimized for Donor, Acceptor, and FRET 
channels. 

2. Optically align cubes to within 1 pixel resolution; if using OCA devices, apply 
run-time software acquisition loop to fluorescent bead visible in all three chan- 

10 nels to achieve alignment. 

3. Combine images acquired through the three cubes into one RGB image. 

4. Either skip to step 9 or perform steps 5-8. 

5. Orthonormalize the RGB image by selecting pixels representative of donor, 
acceptor, and FRET pixels. 

15 6. Repeat step 5 if choice of candidate pixels yields poor mapping of color to either 

biological morphology or standards. 

7. Optionally, save orthonormalization template for application to subsequent 
images. 

8. Contrast enhance R, G, and B in the orthononnalized RGB image. END. 
20 9. Correct the RGB image for background. 

10. Further correct for spectral overlap according to equations related to F c . 

11. Contrast enhance R, G, and B in the corrected RGB image. 

12. Optionally, perform steps 5,6,7,8. 

25 Aspects of the invention may be implemented in hardware or software, or a combina- 

tion of both. However, preferably, the algorithms and processes of the invention are imple- 
mented in one or more computer programs executing on programmable computers each 
comprising at least one processor, at least one data storage system (including volatile and 
non-volatile memory and/or storage elements), at least one input device, and at least one 

30 output device. Program code is applied to input data to perform the functions described 



-29- 



BNSDOCID: <WO 9855026A1 J_> 



WO 98/55026 



PCT/US98/11390 



herein and generate output information. The output information is applied to one or more 
output devices, in known fashion. 

Each program may be implemented in any desired computer language (including 
machine, assembly, high level procedural, or object oriented programming languages) to 
5 communicate with a computer system. In any case, the language may be a compiled or 
interpreted language. 

Each such computer program is preferably stored on a storage media or device (e.g., 
ROM, CD-ROM, tape, or magnetic diskette) readable by a general or special purpose 
programmable computer, for configuring and operating the computer when the storage media 
10 or device is read by the computer to perform the procedures described herein. The inventive 
system may also be considered to be implemented as a computer-readable storage medium, 
configured with a computer program, where the storage medium so configured causes a 
computer to operate in a specific and predefined manner to perform the functions described 
herein. 

15 

Examples 

The capabilities of the MicroFRET device are demonstrated in the EXAMPLES by 
employing a pair of two widely used fluorescent protein tags. A wider range of applications 
for this instrument in cell biology studies are possible as more GFP variants with shifted 

20 excitation and emission spectra are constructed. Other fluorescent molecules and fluoro- 
phores besides GFP derivatives can be analyzed in this instrument by simply choosing an 
appropriate set of epi fluorescence cubes, wherein the donor, acceptor and FRET cubes are 
designed to separate these signals based on their excitation and emission spectra. Further- 
more, this system could also be used with non-protein chromophores such as organic dyes or 

25 lanthanide metals, or with combinations of all of these types. 

The technique of specific fluorophore-to-bead coupling can be extended to include 
other chemistries that do not rely on agarose beads, His-tagging, nickel derivatization, or 
fluorescent proteins. Thus, the beads can have two organic molecules acting as the FRET pair 
(e.g., fluorescein and rhodamine) while maintaining the ability to selectively release the 

30 fluorophores into solution. 
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Accordingly, the following EXAMPLES are illustrative and are not intended to limit 
the scope of the present invention. 

EXAMPLE 1 

5 FLUORESCENT PROTEINS AND BEADS 

This EXAMPLE outlines a procedure to fabricate FRET calibration standards. This 
involved the synthesis of three types of beads: pure donor; pure acceptor; and FRET beads 
bearing both donor and acceptor molecules. Each bead type was synthesized as a series, 

10 where the values of [D], [A], and E were varied. To construct this series of beads, a Ni/NTA- 
competitive binder ("S", for spacer) that is His-tagged and has a similar size and shape as the 
donor and the acceptor was used. In the case of GFP derivatives, several nonfluorescent 
mutants have been engineered which exhibit a "null" fluorescence phenotype, but nonetheless 
express large quantities of protein deficient in chromophore (e.g., point mutation R96M). 

15 Such His-tagged derivatives make excellent spacers on the surface of the Ni/NTA beads 
amongst other spectrally active GFP derivatives. The beads can be loaded with protein 
solutions systematically varied in D, A, and S. 

GFP-adsorbed bead standards were prepared using the following procedure. To 
facilitate protein purification and later attachment on Ni-Sepharose beads, BFP1 1, RSGFP4, 

20 and the R96M variant were engineered to include His 6 tags on their amino-termini. The 
mutant BFP1 1 , constructed using combinatorial mutagenesis, contains the mutations 
F64M/Y66H (Lossau et al, Chem. Physics. 213:1-16, 1996) and is similar to the mutant of 
Heim et al (Proc. Natl. Acad. ScL USA 91 : 12501 -12504, 1994). It has blue-shifted excitation 
and emission maxima relative to wild-type GFP (FIG. 2 and TABLE 2 infra). The mutant 

25 RSGFP4, generated by combinatorial mutagenesis by Delagrave et al (Bio/Technology, 
13:151-154, 1995), contained the mutations F64M/S65G/Q69L. RSGFP4 has spectral 
properties similar to the S65T mutant also reported by Heim et al {Proc. Natl Acad. Sci. 
USA 91:12501-12504, 1994). As the acceptor in a FRET pair, both S65T and RSGFP4 are 
superior to other red-shifted excitation mutants such as RSGFP8 (F64L + S65T), because the 

30 latter mutant has significant excitation in the violet. 
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The proteins were expressed in E. coli strain BL21(DE3), grown for 24 hours, 
ruptured in a French press, applied to a Novagen HisBind purification column, eluted in 1 M 
imidazole, and dialyzed. The final protein concentration was determined by a Bradford assay 
(Bio-Rad). An SDS-PAGE gel was run to confirm the purity and size of the dialyzed fraction 
(data not shown). Fluorescence excitation and emission spectra were recorded on a Photon 
Technology QM-1 fluorimeter. 

HiTrap metal chelating Sepharose beads are charged according to the manufacturer's 
(Pharmacia Biotech) instructions by washing the beads with 50 mM NiS0 4 . The beads are 
then washed extensively with 50 mM Tris-HCl ( P H 8.0) to remove traces of uncomplexed 
nickel ions. A solution is made of purified proteins at a total protein concentration of 
approximately 0.4 mg ml"' in 50 mM Tris-HCl buffer. This dilute concentration is used to 
avoid GFP dimer formation in solution. 1.5 ml of this mixture is added to 50 ul of a bead 
slurry and incubated on ice for 1 hour with frequent mixing. Excess protein ensures that the 
beads are fully loaded. To remove nonspecifically bound protein (if any) the suspension is 
washed twice with a buffer containing 5 mM imidazole, 0.5M NaCl and 20 mM Tris-HCl, 
followed by one wash with 50 mM Tris-HCl. All washes are done by centrifuging the beads 
at 1,000 * g for 30 sees, in a microcentrifuge and resuspending the pellet in the appropriate 
buffer. The mean particle size of the beads is approximately 34 um. 

FIG. 6 shows the surface of the chelating bead, as represented by a horizontal black 
line, with GFP donors and acceptors (e.g., BFP and RSGFP) shown as blue and green vertical 
lines, respectively. Six different types of possible interactions are labeled A-F. In this 
drawing, only adjacent molecules are considered to be within an efficient FRET distance. 

The most heavily loaded beads were produced (under saturating conditions) to have 
optical densities under 0. 1 ; therefore, photon-mediated trivial energy transfer or reabsorption 
do not have to be considered. In addition, the bead size is sufficiently large that surface 
resonance effects can be ignored. 
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EXAMPLE 2 
CONVENTIONAL FLUORJMETRY 
ON THE GFP-LABELED FRET BEADS 

5 To confirm that the fluorescence emission from the FRET bead is actually FRET, as 

well as to ensure that the spectral properties of the two GFP variants have not changed as a 
result of binding to the Sepharose beads, a sample of each type of bead was treated with 
imidazole, which releases the protein. Fluorescence emission spectra for the FRET beads are 
shown in FIG. 2 and 8. The thick line of the B panels shows the emission spectrum of a 

10 suspension of FRET beads excited at 370 nm. The thin line of the B panels shows the 

emission spectrum of the same beads after both RSGFP8 and BFP-1 1 have been released 
from the beads by treatment with imidazole. The decreased donor emission and enhanced 
acceptor emission are characteristic of FRET. This effect is reversed when the two proteins 
are released from the beads. 

is To determine [D] and [A] for each bead in a series, the concentrations of donor and 

acceptor were first measured in solution after release by treating with imidazole. This is best 
performed spectroscopically using known extinction coefficients or against known standards, 
since it is not possible to distinguish D, A and S with simple protein assays. The surface 
concentration of S is unimportant, because it is being used simply as a spacer and has no 

20 spectral properties in terms of visible absorption or fluorescence. After correcting for the 
increase in volume attributable to the addition of the imidazole (typically a factor of L25 x 
after adding a 1/4 volume of a 5 M solution), surface concentrations of donor molecules on 
pure donor beads can be determined from the following: 



25 



[D]: 



[■P] Released in solution 



where d is the bead diameter which is given by the manufacturer, or alternatively 
measured using a stage micrometer and known magnification factors. Bead concentration 
([B]) in units of particles per ml, can be determined very accurately using a cell sorter. This 
has already been performed for three bead slurries, which were constructed under saturating 
30 fluorophore conditions. Fluorophore concentration measurements can be made for the pure 
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acceptor and FRET beads using equations similar to equation (40). In the case of FRET 
beads, total donor and total acceptor concentrations can be determined after release. 

EXAMPLE 3 

5 DATA ACQUISITION FOR GFP-LABELED BEADS 

FIG. 3 shows a set of monochrome images obtained for a mixture of labeled 
Sephadex beads. Individual beads were coated with either (1) BFP-1 1 alone (donor beads), 
(2) RSGFP8 alone (acceptor beads) or (3) a 2:1 mixture of donor and acceptor (FRET beads). 

10 FIG. 3, lower right, shows the intensity of fluorescence emitted by all of the beads in the 
donor emission channel when excited by light corresponding to the donor's excitation 
spectrum. FIG. 3, lower left, shows the fluorescence emitted by the same beads in the 
acceptor channel when excited by light corresponding to the acceptor's absorption spectrum. 
FIG. 3, upper right, (the "FRET" channel) shows the fluorescence emitted in the acceptor 

15 channel when excited by light corresponding to the donor's excitation spectrum. The results 
from these monochrome images are displayed together in a pseudocolor image, with the 
fluorescence signal from the donor channel assigned the color blue, the signal from the 
acceptor channel assigned the color green, and the signal from the FRET channel assigned 
the color red (FIG. 3, upper left). In this image, the color intensities in each of the three 

20 channels are scaled to the pixel (from any of the three channels) with the highest grayvalue 
(DEFAULT setting). The FRET beads appear gold because these beads have fluorescence 
contributions in all three channels. The pure donor beads appear puiple (blue-red) because 
these beads have fluorescence contributions from the donor (blue) and FRET (red) channels. 
The pure acceptor beads appear mostly green with a slight reddish color because these beads 

25 have fluorescence contributions from the acceptor (green) and FRET (red) channels. It is 

evident from these images that there is significant bleed-through of both donor and acceptor 
emission into the FRET channel. 
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EXAMPLE 4 

IMAGE ACQUISITION OF GFP-LABELED BEADS 

Three monochrome images were acquired using the set of three epi fluorescence cubes 
5 {see, TABLE \) to image a mixture of three different types of fluorescent beads (described in 
TABLE 2). The epifluorescence cubes and bead types are labeled Donor, Acceptor, and 
FRET to emphasize that the cubes and beads are spectrally matched. The donor bead carries a 
GFP derivative (BFP1 1) with an excitation maximum in the long wave UV and emission in 
the blue. The acceptor bead carries RSGFP4, which is excited maximally in the cyan and 
10 fluoresces in the green. These excitation and emission wavelengths are matched to the donor 
and acceptor cubes. The FRET bead carries both the blue and green GFP derivatives, and the 
corresponding FRET cube is optimized to excite the blue donor and image the green acceptor 
after energy transfer has occurred. Images acquired using the Donor, Acceptor, and FRET 
cubes are referred to as the Dl, Al, and Fl images, respectively. 

15 





TABLE 2 




Spectral characteristics of fluorescent beads used in this work. Wavelengths (nm) are 


given as A max . 






Bead / Derivative 


Excitation 


Emission 


Donor / BFP 11 


380 


445 


Acceptor / RSGFP4 


490 


510 


FRET / BFP 1 1 +RSGFP4 


380 


510 



25 Spectral mixing among the donor, acceptor, and FRET beads can be observed in the 

spatially coregistered monochrome and RGB images of FIG. 3. In the Dl image, the donor 
beads are the brightest, but dimmer FRET beads are also observed. In the Al image, the 
acceptor beads are the brightest, but dimmer FRET beads are also observed. In the Fl image, 
the FRET beads are the brightest, but dimmer donor beads are observed. This is consistent 

30 with the fluorescence spectra shown in FIG. 2 and the parameters given in TABLE 2. The 

pseudocolored, upper left image (RGB 1 ) in Fig. 3 is the result of encoding the pixel values of 
each of these monochrome images into an intensity value for each of the red, green and blue 
components of the image. Fl is loaded into the red color channel, Al is loaded into the green 
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color channel and Dl is loaded into the blue color channel. Because of spectral overlap, the 
various bead types are not visually distinct or well defined in this RGB image. 

Careful observation of the emission spectra of the donor and the acceptor shows that 
there is no wavelength at which the two fluorophores can be separated. For example, the use 
5 of a very narrow bandpass emission filter at 550 run would not only fail to separate the two 
fluorophore's emissions, but it would also result in the loss of most of the microscope's light 
gathering ability. Using higher intensity illumination to compensate for this loss is likely to 
result in photobleaching. In contrast, the invention uses broad-band emission filters and a 
relatively low intensity excitation source. 

10 

EXAMPLE 5 

COLOR-CODED IMAGES OF BACULOVIRUS-INFECTED Sf9 CELLS 

Baculovirus-infected Sf9 cells expressing BFP1 1, RSGFP4, and a BFP1 1/RSGFP4 
15 fusion protein were tested (as shown in FIG. 7). After proper calibration of the system using 
FRET Beads, the [D] values are equal to zero in the RSGFP4-infected cells, and [A] values 
are equal to zero in the BFPl 1 -infected cells. FRET efficiencies in the BFP1 1/RSGFP4 
fusion-protein-infected cells are equal to or less than the efficiency for the isolated fusion 
protein measured in solution, depending on the extent of proteolysis. 
20 The extent of photobleaching and photoisomerization is less than 5%, as previously 

measured for the MicroFRET system using similar cubes, light sources, and CCD cameras. 

EXAMPLE 6 

MEASUREMENT OF DONOR PHOTOBLEACHING 

25 

Steady-state FRET imaging of cells by sensitized emission using conventional 
microscopy has previously suffered from an inability to correct for spectral overlap while 
maintaining spatial co-registration. Until now, the three epifluorescence cubes (donor, 
acceptor and FRET) that must be used to generate the correction values have been manufac- 
30 tured with optical surfaces that are not strictly parallel. This defect created geometric 

distortions in the image {le., displacement of pixels) after the images were combined. The 
MicroFRET instrument employs epifluorescence cubes which have been machined to precise 
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tolerances, so that spatial co-registration is maintained for all of the images. This design also 
makes it feasible to detect relatively small amounts of FRET within a given pixel because the 
mathematical correction is much simpler (and therefore more accurate) than was previously 
possible. 

The effectiveness of these corrections was demonstrated by obtaining images of 
Sepharose beads loaded with either BFP-1 1 , RSGFP4 or a defined mixture of the two (which 
is known lo generate FRET). By using these beads as calibration standards, spectral overlap 
was corrected for and features identified within the image displaying donor emission, 
acceptor emission and donor-sensitized acceptor emission (FRET). By subsequently applying 
the orthonormalization algorithm ("pixel purification"),. the pure donor, pure acceptor and 
FRET beads were pseudocolored as blue, green and red, respectively. 

Another concern in using the sensitized emission technique has been that the exciting 
light can photobleach the donor and thereby reduce the apparent intensity of the FRET signal. 
The sensitized emission technique does not reduce the FRET signal by more than 5% when 
using the method of the invention. Photobleaching is not a major problem because the high 
sensitivity of the K7 camera makes long exposures unnecessary. The grayscale intensities of 
the fluorescent signals in the experiments, for example, used approximately 1/3 of the total 
dynamic range of the camera (maximum = 65535 bits). Nevertheless, under these exposure 
conditions, less than 5% of the donor signal was photobleached. The exposure time could 
easily be reduced by a factor of 10 and still allow the signal to be detected. 

The maximum extent of photobleaching of the BFP-1 1 donor during a FRET 
measurement was determined by monitoring the intensity of fluorescence emission from a 
sample of donor beads which were repeatedly given 30 sec. exposures to the exciting light. 
The mean grayscale value was determined for ten randomly selected pixels after multiple 
exposures, and these values were compared to the values for the same beads after the initial 
30 sec. exposure. The measured intensity of the fluorescence emission after repeated 
exposure to the exciting light was >95% of the initial level. 
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EXAMPLE 7 
QUANTITATIVE FRET MICROSCOPY 

The purpose of this EXAMPLE is to show that it is feasible to perform quantitative 
5 FRET microscopy by determining the donor concentration, acceptor concentration, energy 
transfer efficiency, and distance parameters between donor and acceptor molecules for every 
pixel in a microscopic field of view. 

Quantitative Imaging was performed using an Olympus AX70 epifluorescence 
microscope equipped with three cubes matched to the excitation and emission spectra of the 
10 GFP derivatives (TABLE 3). These cubes were spatially coregistered to single-pixel 

accuracy. Images taken with each cube form the input of three channels, which were used for 
subsequent image processing. The C { channel was designed to selectively excite and image 
donor emission, the C 2 channel was designed to selectively excite and image acceptor 
emission and the C 3 channel was designed to visualize FRET, since excitation was at the 
15 donor excitation and imaged at the acceptor emission. 



TABLE 3 

Spectral characteristics of epifluorescence cubes used for BFP1 1/RSGFP4. Wavelengths 
(nm) are given as cut-on and cut-off (50% peak transmission) for excitation and emission 
filters and as the inflection point for dichroic filters. 


Cube 


Excitation (nm) 


Dichroic (nm) 


Emission (nm) 


Donor (BFP11) 


335 -380 


410 


435 - 490 


Acceptor (RSGFP4) 


450 - 490 


495 


505 - 550 


FRET 


335 - 380 


410 


505 - 550 



EXAMPLE 8 

ORTHONORMALIZATION OF CHROMOGENIC DYES 

Color space transformation algorithms are useful for rapidly identifying and highlight- 
ing groups of pixels or features in images which have very subtle or overlapping color 
difference. For example, FIG. 9 shows hematoxylin and eosin (H&E) slides of stained thin 
sections of cardiac tissue including an infarct. The left panel shows the true-color image 
generated by combining three separate monochrome images at 450, 550, and 650 nm of the 
H&E stained tissue. The right panel shows this image after orthonormalization. In this 
particular case, candidate pixels for the orthonormalization were picked from nuclei, light- 
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colored eosin. and dark colored eosin-containing regions as R, G, and B, icspectively. The 
resultant image shows two distinct types of eosinophilic tissue. Such differentiation in 
staining by eosin is difficult to see in non-enhanced images. Subtle color differences in eosin 
may correlate with various disease states such as the presence of collagen in tissues. The 
enhanced image has been further enhanced by contrast enhancement of each separate R, G, 
and B color channel. 

EXAMPLE 9 
CORRECTIONS IN TIME-COURSE IMAGERY 

Candidate pixels or features that are used to calculate the color space coordinates of 
the refined image can be selected from a sequence of spatially coregistered images which 
might, for example, involve a time sequence of events. In this embodiment, a series of images 
would be displayed within a window with 'stop', 'start', 'forward' and 'time-delay' parame- 
ters. While the sequence of images might have been obtained over a very fast time course 
(video rates; milliseconds per frame), the player would enable the end user to slow down the 
visualization process to the extent that candidate pixels would be picked as the basis for the 
color space transformation. Coefficients to these specific transformations would be applied to 
all frames in the image sequence; the heuristics of a user-desired morphology would utilize a 
graphical user interface to evaluate whether the candidate pixels were a good pick. This 
method may be very important in ratio-metric dynamic imaging of live cells, wherein 
movements of protein, ions, and other cellular components are reported through fluorescence 
and FRET. Other evaluation criteria for determining whether the candidate pixels were 
properly chosen include the segregation of colors onto known standard targets. 

The mathematical coefficients determined during the conversion of an unprocessed to 
processed image utilizing an image containing known standards, can be saved and applied to 
an image containing no standards. This standardization template can be recalled and the 
coefficients used to correct subsequent images taken under similar conditions of illumination, 
optical filtration and recording. 
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A number of embodiments of the present invention have been described. Neverthe- 
less, it will be understood that various modifications may be made without departing from the 
spirit and scope of the invention. For example, the invention described above is clearly not 
limited to FRET analyses of GFP derivatives on specific beads, but these experiments do 
demonstrate a reduction to practice of an imaging spectrophotometer and methods capable of 
detecting FRET. Accordingly, other embodiments are within the scope of the following 
claims. 
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WHAT IS CLAIMED IS: 

1 . A method for transforming an initial image of biological material to a processed image, 
the initial image being represented by a set of pixels each having three color space 
coordinates, the method including the steps of: 

(a) selecting at least two image regions in the initial image, each image region including 
at least one pixel, wherein the image regions define at least two distinguishable 
spectral categories; 

(b) performing a color space transformation on the initial image, based on the color 
space coordinates of the pixels in each of the selected image regions, to generate a 
processed image; and 

(c) evaluating the processed image for a visible indication of an improved spatial 
distribution of color. 

2. The method of claim 1, where the color space transformation is an orthonorrnalization 
transformation, wherein grayvalues of selected pixels are used to construct the matrix 



A„ 


A I2 


A I3 






A 22 


A 23 




A„ 


A 32 


A 33 


= [A] 



which is transformed to the matrix 





0 


0 


0 


c 22 


0 


0 


0 


c 



3. The method of claim 1, where the color space transformation is a spectral overlap 
correction. 
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1 4. The method of claim 1 , where the color space transformation is a spectral overlap 

2 correction of the form: 

f'=f'-(f:/i>1)xd>-(f:/aI)*a'. 

1 5. The method of claim I , where the image regions include substances that absorb light. 
1 6. The method of claim I , where the image regions include substances that fluoresce. 

1 7. The method of claim 1 , where at least one image region includes a substance that exhibits 

2 FRET. 

1 8. The method of claim 1 , where the step of evaluating is based on the improved spatial 

2 distribution of colors properly segregating to known standard targets. 

1 9. The method of claim 1 , where the step of evaluating is based on the improved spatial 

2 distribution of colors segregating to biological structures. 

1 1 0. The method of claim 1 , wherein the method for transforming includes using a dynamic 

2 series of initial images. 

1 1 1. The method of claim 1, wherein the step of evaluating includes using a confocal micro- 

2 ' scope. 

1 12. The method of claim 1 , wherein the image is within a series of images all corrected 

2 simultaneously. 

1 13. The method of claim 1, wherein the step of evaluating includes using a set of calibration 

2 targets. 

1 14. The method of claim 1 , wherein the image is of a stained thin section of tissue. 
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1 15. A FRET standard, carrying both donor and acceptor molecules, with known FRET 

2 properties used to a calibrate an optical instrument to enable FRET measurements. 

1 16. The FRET standard of claim 15, where the FRET property is efficiency E. 

1 17. The FRET standard of claim 15, where the FRET standard relates a measured intensity of 

2 acceptor fluorescence sensitization to a corresponding amount of donor quenching 

3 according to: 



1 18. The FRET standard of claim 15, where the FRET properties are modulated by association 

2 and dissociation of the donor and the acceptor molecules. 

1 19. The FRET standard of claim 15, where the FRET properties of the standard are deter- 

2 mined by modulating the association and dissociation of the donor and the acceptor 

3 molecules. 

1 20. The FRET standard of claim 1 5, where the FRET efficiency of the standard is determined 

2 by modulating the association and dissociation of the donor and the acceptor molecules. 

1 21. The FRET standard of claim 15, where binding of donor and acceptor molecules to the 

2 set of FRET calibration targets is reversible. 

1 22. The FRET standard of claim 15, where the donor and acceptor molecules are fluorescent 

2 proteins. 

1 23. The FRET standard of claim 15, where the FRET standard includes at least one 

2 fluorescent substance bound to a microscopic bead. 
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24. A method for transforming an initial FRET image to a processed FRET image, the initial 
image being represented by a set of pixels each having three color space coordinates, the 
method including the steps of: 

(a) generating a corrected FRET image from an initial image by correcting for spectral 
overlap by applying a transformation of the form to obtain a corrected FRET channel 
image F c : 

F r = F b - (/•• I Dj )x D b - ( F b /A b a )x A b . 

5 

(b) selecting at least two image regions in the corrected FRET image, each image region 
including at least one pixel, wherein the image regions define at least two distin- 
guishable spectral categories; 

(c) performing a color space transformation on the corrected image, based on the color 
space coordinates of the pixels in each of the selected image regions, to generate a 
processed image; and 

(d) evaluating the processed image for a visible indication of an improved spatial 
distribution of color. 

25. The method of claim 24, including the step of further correcting the corrected FRET 
image for cross-talk resulting from detection of donor fluorescence through an acceptor 
emission channel and detection of acceptor fluorescence through a donor emission 
channel. 

26. The method of claim 24, including the step of further correcting the corrected FRET 
image for non-zero values of Ad, a signal from a donor-only specimen using an acceptor 
filter set, and Da, a signal from a acceptor-only specimen using a donor filter set. 

27. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of a donor. 



-44- 



WO 98/55026 



PCT/US98/11390 



28. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c , so as to be approximately normalized for the concentration of a donor, 
by applying a correction of \/Df, where Df \s a signal generated through a donor filter set 
when both donors and acceptors are present in the biological material. 

29. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of an acceptor. 

30. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c , so as to be approximately normalized for the concentration of a 
acceptor, by applying a correction of VAf, where Af \s a signal generated through an 
acceptor filter set when both donors and acceptors are present in the biological material. 

31. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of both a donor and an acceptor. 

32. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c , so as to be approximately normalized for the concentration of both a 
donor and an acceptor, by applying a correction of \l{Df X AJ), where Df is a signal 
generated through a donor filter set when both donors and acceptors are present, and Af is 
a signal generated through an acceptor filter set when both donors and acceptors are 
present. 

33. The method of claim 24, including the step of further correcting the corrected FRET 
image by correcting for cross-talk resulting from detection of donor fluorescence through 
an acceptor emission channel and detection of acceptor fluorescence through a donor 
emission channel, and by normalizing for the concentration of both a donor and an 
acceptor. 
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1 34. The method of claim 24, wherein the initial FRET image has less than about 5% 

2 photobleaching. 

1 35. An optical instrument for measuring FRET which is calibrated with a FRET standard 

2 having donor molecules and acceptor molecules and that relates a measured intensity of 

3 acceptor molecule fluorescence sensitization to a corresponding amount of donor 

4 molecule quenching. 

1 36. The optical instrument of claim 35, wherein a FRET standard, carrying both donor and 

2 acceptor molecules with known FRET properties, is used to a calibrate an optical 

3 instrument to enable FRET measurements. 

1 37. The optical instrument of claim 35, wherein the FRET measurements can be processed to 

2 yield a FRET efficiency E. 



1 38. The optical instrument of claim 35, wherein the FRET measurements can be further 

2 processed to yield a distance r separating the donor and acceptor molecules. 

1 39. The optical instrument of claim 35, wherein the filters within the epifluorescence cubes 

2 have been selected based on their optical surfaces having no more than 15 arc seconds of 

3 wedge parallelism and no more than 10 waves flatness. 



-46- 



BNSDOCtD: <WO. 



9855026A1_L > 



<» 



40. A computer program, residing on a computer-readable medium, for transforming an 

2 initial image of biological material to a processed image, the initial image being repre- 

3 sented by a set of pixels each having three color space coordinates, the computer program 

4 comprising instructions for causing a computer to: 

5 (a) select at least two image regions in the initial image, each image region including at 

6 least one pixel, wherein the image regions define at least two distinguishable spectral 

7 categories; 

8 (b) perform a color space transformation on the initial image, based on the color space 

9 coordinates of the pixels in each of the selected image regions, to generate a pro- 

10 cessed image; and 

11 (c) evaluate the processed image for a visible indication of an improved spatial distribu- 

12 tion of color. 

1 41. A computer program, residing on a computer-readable medium, for transforming an 

2 initial FRET image to a processed FRET image, the initial image being represented by a 

3 set of pixels each having three color space coordinates, the computer program comprising 

4 instructions for causing a computer to: 

5 (a) generate a corrected FRET image from an initial image by correcting for spectral 

6 overlap by applying a transformation of the form to obtain a corrected FRET channel 

7 image F c : 

8 F< = F" - [F d b /D b d )x D b - (F a b jA b a )x A b . 

9 (b) select at least two image regions in the corrected FRET image, each image region 

10 including at least one pixel, wherein the image regions define at least two distin- 

11 guishable spectral categories; 

12 (c) perform a color space transformation on the corrected image, based on the color 

13 space coordinates of the pixels in each of the selected image regions, to generate a 

14 processed image; and 

is (d) evaluate the processed image for a visible indication of an improved spatial distribu- 
16 tion of color. 
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CALIBRATION OF FLUORESCENCE RESONANCE 
ENERGY TRANSFER IN MICROSCOPY 

STATEMENT AS TO FEDERALLY SPONSORED RESEARCH 

This invention was made at least in part with funds from the Federal Government, 
5 Department of Energy. The Government may have certain rights in the invention. 

CLAIM OF PRIORITY 

This application claims priority under 35 USC §11 9(e) to U.S. Patent Application Serial 
No. 60/048,696, filed June 5, 1997, and to U.S. Patent Application Serial No. 
60/057,931, filed September 4, 1997. 

1 0 TECHNICAL FIELD 

This invention relates generally to fluorescence resonance energy transfer (FRET), and 
more particularly to calibration standards for FRET. 

BACKGROUND 

Fluorescence resonance energy transfer (FRET) is a non-radiative process whereby 
1 5 energy from a fluorescent donor molecule is transferred to an acceptor molecule without 

the involvement of a photon. Excitation of the donor molecule enhances the fluorescence 

emission of the longer-wavelength acceptor molecule (i.e., sensitized acceptor emission). 

The quantum yield of the donor fluorescence emission is concomitantly diminished. 

FRET has become a valuable tool for microscopy, because the efficiency of energy 
20 transfer has a strong inverse dependence on the distance between the donor and acceptor 

molecules. Thus, the appearance of FRET is a highly specific indicator of the proximity 

of the two molecules. This has led to the use of FRET efficiency as a "spectroscopic 

ruler" to measure molecular distances. 

A typical FRET experiment for observing cells involves specifically labeling particular 
25 molecules with fluorescent dyes and detecting these dyes over selected excitation and 
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emission wavelength ranges. These wavelength ranges are commonly referred to as 
"channels" for a particular fluorophore. Fluorescent labeling is easier to accomplish for 
extracellular molecules than for intracellular ones. For intracellular molecules, the dye- 
conjugated molecules must be either injected into the cell for observation or the labeled 
5 molecules may be overlaid onto a thin section of fixed, permeabilized tissue. Recently, 
however, the availability of green fluorescent protein (GFP) mutants with shifted 
excitation and emission spectra has made it feasible to measure protein-protein 
interactions by using GFP tags as intracellular markers. GFP-tagged protein chimeras are 
expressed intracellular^ and do not require any chemical treatment to become 
10 fluorescent. FRET can also occur between fusions of blue-emitting and green-emitting 
GFP variants. 

Although FRET microscopy has the potential to become a widely used analytical tool in 
these systems, accurate steady-state measurement of FRET by standard epifluorescence 
microscopy has been hindered by several limitations, including: 

(1) Bleed-through or spillover of donor (and isolated acceptor) fluorescence 
emission into the FRET channel due to spectral overlap. Compensation for spectral 
overlap requires the use of accurate calibration standards to determine the correction 
factors. 

(2) Image registration. Correcting each pixel in an image for spectral overlap 
requires taking three separate images with each of the three epifluorescence cubes {i.e., 
donor emission, acceptor emission, and sensitized acceptor emission). If the surfaces of 
all three epifluorescence cubes are not exactly parallel, image registration is lost and the 
resultant geometric distortion will also have to be corrected. Loss of image registration 
greatly complicates the correction procedure and reduces the overall accuracy of the 
corrected data. 

(3) Calculation of FRET by sensitized emission has a large uncertainty when 
the FRET efficiency is low. 

(4) Photobleaching of the donor during the measurement results in 
anomalously low estimates of FRET in the sample. 
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These limitations apply to GFP as well as to other fluorescent FRET pairs. 

Because of recent advances in "chromosome painting," cell biologists are becoming 
familiar with epifluorescence microscopes that utilize multi-bandpass filters to obtain 
information on several dyes simultaneously. Some of these instruments employ interfero- 
5 rnetry, while others use filter wheels in the excitation path to select specific excitation 
bands. In both cases, an assumption is made that excitation at a given wavelength results 
in emission from the next reddest transmission band. While multiband cubes help to 
solve the image registration problem for separable dyes, fluorescence phenomena which 
involve large or variable Stokes shifts cannot be addressed. Multiband systems cannot 
10 be used to detect FRET because the FRET emission channel is not the next (redder) 
emission band and is therefore indistinguishable from the donor's emission. 

Accordingly, the inventors have determined that a need exists for an improved FRET 
system which provides for close image registration, and minimizes or corrects for low 
FRET efficiency, photobleaching, and spectral overlap. The present invention provides 
1 5 for such a system. 

SUMMARY 

The invention provides a method for transforming an initial image of biological material 
to a processed image, the initial image being represented by a set of pixels each having 
three color space coordinates. The method includes the steps of (a) selecting at least two 

20 image regions in the initial image, each image region including at least one pixel, 
wherein the image regions define at least two distinguishable spectral categories; (b) 
performing a color space transformation on the initial image, based on the color space 
coordinates of the pixels in each of the selected image regions, to generate a processed 
image; and (c) evaluating the processed image for a visible indication of an improved 

25 spatial distribution of color. 
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The invention further provides a quantitative method for color space transforming an 
initial FRET image of biological material to a corrected FRET image, and includes 
applying other image corrections. 

The invention also provides a set of calibration targets for FRET. The set of calibration 
5 targets includes: (a) a pure donor target for binding only to donor molecules; (b) a pure 
acceptor target for binding only to acceptor molecules; and (c) a donor and acceptor 
target for binding to a mixture of donor and acceptor molecules which exhibit FRET. In 
a specific embodiment, the set of calibration targets are genetically engineered 
derivatives of the Green Fluorescent Protein (GFP) bound to the surface of Ni chelating 
1 0 beads by histidine-tags (His-tags). 

The details of one or more embodiments of the invention are set forth in the accompany- 
ing drawings and the description below. Other features, objects, and advantages of the 
invention will be apparent from the description and drawings, and from the claims. 



DESCRIPTION OF DRAWINGS 

1 5 FIG. 1 a is a block diagram showing one embodiment of a FRET imaging microscope for 
acquiring spatially co-registered electronic images suitable for use with the present 
invention. 

FIG. lb is a diagram of an epi fluorescence filter cube. 

FIG. 2, panel A shows the fluorescence excitation (thin lines) and emission (thick lines) 
20 spectra of BFP1 1 (blue) and RSGFP4 (green) proteins attached to chelating Sepharose 
beads via their His tags. Panel B is a comparison between the fluorescence emission of 
the BFP1 1 and RSGFP4 FRET pair bound (thick line) and following release (thin line) 
from chelating beads. 
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FIG. 3 is an output from a Micro FRET graphical user interface, showing three 
monochrome images taken of the bead mixture using the donor, acceptor, and FRET 
epifluorescence cubes described in TABLE 1 . These images have been combined to 
produce an RGB image which does not fully differentiate among the three bead types 
5 because of spectral overlap. Windows: lower right (C y ); lower left (C 2 ); upper right (C 3 ): 
upper left (RGB). 

FIG. 4 is an orthonormalization of the color axes for a red-green-blue (RGB) display. 
This color-correction algorithm redefines the color axes from the dotted arrows of a 
conventional RGB display (lower left) to the solid axes of the orthonormalized image 
1 0 (upper right). This process results in the primary colors (red, green, blue) being assigned 
to the three pixel or bead types (FRET, Acceptor, Donor), respectively. Thus, the poorly 
differentiated colors of the raw RGB image shown in FIG. 3 (F, A, and D) are 
transformed by orthonormalization into pure red (F') 3 green (A'), and blue (D'). 

FIG. 5 shows the spectral overlap correction and orthonormalization of donor, acceptor, 
1 5 and FRET beads. 

FIG. 6 shows the surface of the chelating bead, as represented by a horizontal black line, 
with GFP donors and acceptors (e.g., BFP and RSGFP) shown as blue and green vertical 
lines, respectively. Six different types of possible interactions are labeled A-F. In this 
drawing, only adjacent molecules are considered to be within an efficient FRET distance. 

20 FIG. 7 is a set of spatially coregistered color-coded images which show Baculovirus- 
infected Sf9 cells expressing a blue-emitting derivative of GFP (i.e., BFP1 1), a green- 
emitting derivative with red-shifted excitation (i.e., RSGFP4), and a BFP1 1/RSGFP4 
fusion protein that is efficient at FRET. The donor, acceptor, and FRET signals have 
been separated and pseudocolored blue, green, and red, respectively, by the qualitative 

25 MicroFRET imaging system based on picking candidate D, A, and F pixels. 
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F1G. 8, panel A shows the fluorescence excitation (thin lines) and emission (thick lines) 
spectra of a blue (BFP1 1) and a green (RSGFP4) GFP derivative chelated to Ni/NTA 
Sepharose beads via the proteins' His-tag, These spectra are virtually indistinguishable 
from those of the corresponding purified proteins in solution. Panel B is a comparison- 
5 between the fluorescence emission (with excitation a, the donor's wavelength 370 nm) 
of the BFP1 1/RSGFP4 FRET pair bound to the bead (thick line) and following release 
(thin hne) by treatment with imidazole. The spectra shown in FIG. 8 confirm that the 
fluorescence emission from the FRET Bead is due to energy transfer, and that the 
spectral properties of the two GFP variants have not changed as a result of binding to the 
1 0 Ni/NTA Sepharose beads. 

FIG. 9 shows hematoxylin and eosin (H&E) slides of stained thin sections of cardiac 
tissue including an infarct. The left panel shows the true-color image generated bv 
combining three separate monochrome images at 450, 550, and 650 nm of the H&E 
stained tissue. The right panel shows this image after orthonormalization in accordance 
1 5 with the invention. 
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DETAILED DESCRIPTION 

Overview 

The invention provides a new system for FRET imaging microscopy, based on epifluore- 
scence microscopy. In a preferred embodiment known as the Micro FRET system, 
precisely machined epifluorescence cubes are used to maintain proper image registration 
in order to allow correction for spectral overlap. The MicroFRET system also utilizes 
fluorescent protein standards which are reversibly bound to high-performance Sepharose 
beads. 



In addition, newly designed software is capable of displaying processed pixel images of 
10 donor, acceptor, and FRET pixel information. Calibration parameters obtained from 
tagged beads can be applied to other images where the conditions under which the 
images are acquired are identical. This new design also makes it feasible to detect 
relatively small amounts of FRET within a given pixel, because the mathematical 
correction is much simpler (and therefore more accurate) than was previously possible. 

15 Steady-state FRET imaging of cells by sensitized emission, using conventional 
microscopy, has previously suffered from an inability to correct for spectral overlap 
while maintaining spatial accuracy. Until now, the three epifluorescence cubes (donor, 
acceptor and FRET) that must be used to generate the correction values have been 
manufactured with optical surfaces that are not strictly parallel. This defect created 

20 geometric distortions in the image (i.e., displacement of pixels) after the images were 
combined. The invention utilizes epifluorescence cubes which have been machined to 
precise tolerances, so that spatial co-registration is maintained for all of the images. The 
invention also provides beads that are useful as calibration standards, so that spectral 
overlap can be corrected and features can be identified within the image that display 

25 donor emission, acceptor emission, and donor-sensitized acceptor emission (FRET). By 
subsequently applying an orthonormalization algorithm ("pixel purification"), the pure 
donor, pure acceptor, and FRET beads are processed as blue, green, and red, respectively. 
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The processing is useful to cell biologists who seek to determine the spatial distribution 
of each of the three fluorescent components. 

Another concern with sensitized emission using conventional microscopy has been that 
the exciting light can photobleach the donor, thereby reducing the apparent intensity of 
5 the FRET signal. However, by utilizing a high sensitivity camera, the sensitized emission 
technique of the invention does not reduce the FRET signal by more than about 5%. 

The invention provides quantitative FRET technology in 3-dimensional imaging systems 
such as confocal microscopes. Potential applications of quantitative FRET microscopy 
are almost innumerable and span several disciplines in biology, from basic mechanistic 
1 0 aspects of cell biology to the discovery of new pharmaceuticals. 

The device of the invention and improved methods for FRET microscopy will facilitate 
cell biology experiments involving tagged proteins (e.g., protein-protein interactions) as 
well as drug discovery (protein-small molecule interactions), where there is a need to 
quantitate the extent to which two molecules are interacting. 

1 5 The invention includes bead standards applicable to 3-D imaging, as well as software that 
calibrates volume elements. 

Unless otherwise defined, all technical and scientific terms used herein have the same 
meaning as commonly understood by one of ordinary skill in the art to which this 
invention belongs. Although methods and materials similar or equivalent to those 
20 described herein can be used in the practice or testing of the present invention, suitable 
methods and materials are described below. 

All publications, patent applications, patents, and other references mentioned herein are 
incorporated by reference in their entirety. In case of conflict, the present application, 
including definitions, will control. In addition, the materials and methods described 
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herein are illustrative only and not intended to be limiting. Other features and advantages 
of the invention will be apparent from the following detailed description, the drawings, 
and from the claims. 

Optical Instrumental ion 
5 The methods of the invention use an optical device that acquires spatially co-registered 
electronic images. For example, the optical instrument can be a microscope and digital 
camera. The microscope can be a steady-state, wavelength-scanning fluorescence 
microscope (i.e., not a time-resolved system or noi an interferometer-based system). The 
optical instrument can also provide for background subtraction, spectral overlap 
10 corrections, and transformation of data from three channels set into a color space defined 
by the primary colors of red, green, and blue. The transformation of data produces an 
enhanced image in which FRET, acceptor, and donor pixels are more clearly differenti- 
ated and pseudocolored accordingly. 

FIG. la is a block diagram showing one embodiment of a FRET imaging microscope for 
15 acquiring spatially co-registered electronic images suitable for use with the present 
invention. The structure includes a microscope 1 . a detection camera 2, a light source 3, 
a set of three interchangeable epifluorescence cubes 4 (donor, acceptor, and FRET), an 
image processor 5, and an image output device 6. 

In a specific embodiment, the MicroFRET instrument is based on an Olympus BX60 
20 (upright) or 1X70 (inverted) epifluorescence microscope 1 . The detection camera 2 uses 
aKAIROS Peltier-cooled charge-coupled device (CCD) camera (Model K7: 16 bit, 760 
x 510 resolution, or Model K8: 16 bit, 1 340 x 1037 resolution) coupled to the trinocular 
port of the microscope 1. The detection camera 2 coupling to the microscope is made 
through a c-mount to Olympus U-PMTVC and Olympus U-SPT relay tubes (containing 
25 a 2.5 x projection eyepiece). The threaded U-PMTVC mount can be adjusted to make the 
detection camera 2 parfocal with the oculars. Other hardware components used in this 
study include a 1 OX/0.40 objective (U-plan apo infinity/0.17). 
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The light source 3 for excitation illumination can be provided by a 75 watt quartz 
tungsten halogen (QTH) light source coupled directly to the microscope 1 , although other 
light sources may be used if desired. Exposure lime is controlled by an electronic shutter 
in the detection camera 2. Typical exposure times are 0.15-2 seconds. The use of low 
5 light doses in imagery was enabled by minimizing exposure time and intensity, using 
extremely sensitive CCD cameras, and by carefully selecting epifluorescence cubes 4 
with broad band emission filters and narrow band excitation filters. Spectral 
deconvolution algorithms readily correct for the broad-band emission filters. 

FIG. lb is a diagram of an epifluorescence filter cube 4. Each epifluorescence cube 4 
10 includes an excitation filter 10, an emission filterl 1, and a dichroic mirror 12. The 
excitation filter 10 is a band pass or high pass filter that allows only short wavelength 
light from a light source to pass through. The emission filter 1 1 is a band pass or low pass 
filter that passes only long wavelength light emitted by the object in response to 
illumination by the shorter wavelength exciting light. The dichroic mirror 12 is a beam 
1 5 splitter that reflects the exciting light onto the object and then allows emitted light from 
the object to pass through. The "cut on" wavelength of the dichroic mirror 12 generally 
lies between the transmission bands of the excitation filter 1 0 and the emission filter 1 1 
in a simple configuration. 

The methods of the invention use epifluorescence cubes 4 which have been machined to 
20 precise tolerances, so that spatial co-registration is maintained for all of the images. This 
design also makes it feasible to detect relatively small amounts of FRET within a given 
image pixel, because the mathematical correction is much simpler (and therefore more 
accurate) than was previously possible. The epifluorescence cubes 4 are precisely milled 
and fabricated, such that there is less than 5 arc seconds deviation between the two planar 
25 surfaces of each of the dichroic mirrors and emission filters in the epifluorescence cubes. 



This low deviation between the two planar surfaces of each of the dichroic mirrors and 
emission filters results in a high degree of image registration. Because image registration 
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and distortion are highly dependent on exact surface parallelism within the dichroic and 
emission filters' surfaces, the dichroic and emission filters of all three cubes were 
measured for surface parallelism (using an autocollimator) and for surface flatness (using 
an interferometer) and found to be less than or equal to 1 5 arc seconds of wedge 
5 parallelism and approximately 10 waves flatness. Epifluorescence cubes having suitable 
characteristics were manufactured by Chroma Inc. (Brattleboro, VT) to the specifications 
of less than 2 waves flatness and 5 arc seconds wedge. Lesser quality epifluorescence 
cubes can be corrected by optical centering adjustment (OCA) devices (from Olympus 
of Huntington, NY) in conjunction with donor (D) ? acceptor (A), and FRET (F) cubes to 
1 0 co-align images in run time using a focusing/alignment acquisition loop implemented in 
software. The target can be a fluorescent bead (size = point source) visible in all three 
channels and aligned to one pixel in co-registration among the three channels. This is a 
novel use of OCA's for FRET. Preferred epifluorescence cube specifications are 
described in TABLE 1 . 



15 



20 



TABLE 1 

Spectral characteristics of epifluorescence cubes. Wavelengths (nm) are 
given as cut-on and cut-off (50% peak transmission) for excitation and 
emission filters, and as the inflection point for dichroic filters. 



Cube/Channel 



Donor/C, 



Acceptor/Q> 



FRET/C^ 



Excitation 



335 -380 



450-490 



335 -380 



Dichroic 



410 



495 



410 



Emission 



435 - 490 



505 - 550 



505 - 720 



25 



The C, channel (arbitrarily assigned to Blue) was designed to selectively excite and 
image donor (D) emission, the C 2 channel (arbitrarily assigned to Green) was designed 
to selectively excite and image acceptor (A) emission, and the C 3 channel (arbitrarily 
assigned to Red) was designed to visualize FRET (F) emission, since excitation was at 
the donor excitation and imaged at the acceptor emission. 



Conventional epifluorescence cubes may be replaced by Fluorescence Imaging Mi- 
cro-Spectrophotometer (FIMS) technology or other methods which do not use a set of 
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three fixed-wavelength devices. In FIMS, the emission filter is continuously variable and 
the excitation wavelength can be selected by another device, such as a monochromator. 
A description of the FIMS technology is set forth U.S. Patent Application No. 
08/833,351, filed 2/10/98, entitled "Optical Instrument Having a Variable Optical Filter", 
5 and assigned to the assignee of the present invention. 

The image processor 5 may be a suitably programmed personal computer. The image 
output device 6 may be a computer monitor (e.g., CRT or LCD display) or a printer. In 
operation, a monochrome image of an illuminated sample is taken by the detection 
camera 2 through the microscope 1 and input into the processor 5 as a digitized pixel 
1 0 image. A set of three such images from each channel (donor, acceptor, and FRET) can 
then be processed as three spatially coregistered images or treated as a single image in 
which each pixel has three color space coordinates corresponding to the monochrome 
wavelengths. 

The method of the invention is not limited to an epifluorescence microscope. 
1 5 Macroscopic lens-based systems could be used in place of the microscope's objectives 
to achieve FRET detection and quantitation over a macroscopic field of view, such as a 
microtiter tray or petri dish (in biology), or a solid state device (in materials science). 
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FRET Physics 

The Forster equations, which are the basic equations describing FRET, involve 
expressions for the energy transfer rate constant (k,). the transfer efficiency (E), the so- 
called Forster radius or critical distance (R^, in cm), the spectral overlap integral (J (A.)) 
5 and the normalized fluorescence emission spectrum of the donor (f (X)): 



k t -(R 0 /r) 6 (l/x d ) (]) 

E=[l +(r/R 0 )*r (2) 

R. = [8.79 x 10" 25 J(X)K 2 Q D n- , ] ,/6 (3) 

JW=I/W e A (A) X A dX (4) 

10 f(X) = ¥ D (X)dX/j¥ D (X)dX (5) 

r is the center-to-center distance (in cm) between the donor and acceptor chromophores, 
T d is the fluorescence lifetime of the donor in the absence of energy transfer, k 2 is the 
dipole-dipole orientation factor, Q D is the fluorescence quantum yield of the donor in the 
absence of the acceptor, n is the refractive index of the intervening medium. ¥ D (X) is the 
1 5 fluorescence emission intensity of the donor at a given wavelength X (in cm), and e A (X) 
is the extinction coefficient of the acceptor chromophore (in cnr'M* 1 ). J(A) therefore 
expresses the normalized fluorescence spectrum of the donor and has units ofM^cm 3 . 

For randomly oriented molecules separated by a distance /% when r = R Q , the efficiency 
of energy transfer is 50%, and the donor fluorescence lifetime is reduced by a factor of 

20 2. Values of R 0 are on the order of tens of Angstroms. FRET efficiencies fall-off at an 
inverse 6 th power of distance as normalized by R 0 . Doubling the distance between donor 
and acceptor molecules from R 0 to 2^ decreases the FRET efficiency from 50% to 
approximately 1% because of the inverse^ power dependence: (0.5]f . Thus, FRET is 
a very useful tool for determining whether two molecules are in close proximity. This is 

25 especially true in the case of interacting macromolecules, where molecular radii are 
similar in size to the actual R 0 values of their fluorescent tags. 
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The extent to which the donor emission is quenched by the acceptor can be used to 
calculate the FRET efficiency E according to one of Forster's equations: 

E- tp-tpA (6) 

where I D and I DA are the fluorescence intensity of the donor in the absence and presence 
5 of acceptor, respectively. This is equivalent to determining the concentration of donors 
performing FRET, divided by the total concentration of donors. 

For most cell biologists, a useful measurement is the relationship of E to r within a color- 
coded image. The invention provides simple models to convert E to the donor-acceptor 
distance (r). 

1 0 Correcting Spectral Overlap 

In one embodiment, the inventive method corrects for spectral overlap between the donor 
and acceptor channels (selected excitation and emission wavelength ranges, see supra) 
The mathematical basis for the spectra! overlap corrections is provided as follows: 

(7) 

1 5 where X can be substituted by "D", "A", or "F" to indicate an image pixel from one of 
the monochrome fluorescence images acquired through the Donor, Acceptor or FRET 
channels, respectively. The subscript "u", can be substituted by "d", "a" or "f ' to 
represent a pixel from either a donor, acceptor or FRET bead in the image. Since there 
is substantial spectral overlap, more than one bead type can be seen in each unprocessed 

20 channel (FIG. 3). The superscript "y", in the equations (8) and (9) below, is replaced by 
"b" to indicate that the monochrome image has been background subtracted before 
spectral overlap corrections are performed. 

ratio of FRET channel intensity to Donor channel intensity for a 
"pure donor" pixel after background subtraction on each monochrome 



25 



image. (8) 
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= ratio of FRET channel intensity to Acceptor channel intensity for a "pure 
acceptor" pixel after background subtraction on each monochrome imag<.9) 

These ratios are the fractional "bleed" or spectral overlap of donor and acceptor, 
respectively, into the FRET channel. They are then used to correct the FRET channel 
5 pixel intensities. Each pixel in the conected FRET channel image (F c ) is given by: 

After background and spectral overlap corrected monochrome images are obtained for 
each channel, the three images are combined into a composite RGB image to create a 
corrected FRET image. In the illustrated embodiment, the donor channel is not corrected 
10 for acceptor bleed and the acceptor channel is not corrected for donor bleed because 
these effects are minimal. 

The correction for spectral overlap is performed as follows: The ratio of the FRET 
channel intensity to the donor channel intensity is determined for a "pure donor" pixel 
after background correction. The ratio of the FRET channel intensity to the acceptor 
15 channel intensity is also determined for a "pure acceptor" pixel after background 
correction. These ratios are then used to correct the FRET channel values for each pixel. 

Orthonormalization 

In one embodiment, the method uses orthonormalization to convert donor, acceptor, and 
FRET signals into unique colors. For example, the donor, acceptor, and FRET signals 
20 are converted to B(lue), G(reen), and R(ed). An orthonormalization procedure which 
qualitatively enhances the corrected image is described below. 

In addition to the spectral overlap algorithm given above, the image can be further 
enhanced by the construction of RGB images based on an orthonormalization 
transformation. This process results in the FRET, acceptor, and donor pixels being 
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pseudocolored by pure primary colors: red, green, and blue respectively. To do this, 
selected pixel values from each of the previously processed monochrome images can be 
used to construct a 3 x 3 matrix, referred to as the A matrix: 
Monochrome Image 



5 




(Grayvalue 


Image) 






F 


A 


D 






r 




1 




f 


|A U 


A 12 


A]3 | 


Selected Pixel 


a 


|A 21 


A 22 


A 23 | 


10 


d 


|A 31 


A 32 


a 33 I 






L 




j 



= [A] (11) 

Columns in [A] represent the three previously processed monochrome images and rows 
represent selected pixels. For example, A,, is equal to a pixel value in the FRET image 
which corresponds to the location of a FRET bead. A 12 and A, 3 are equal to the pixel 
1 5 value in the acceptor and donor images, respectively, at this same position. 

The goal of the orthonormalization operation is to transform the A matrix into the 
following matrix: 

Monochrome Image 

(Grayvalue Image) 

20 



25 





F 


A 


D 






r 






1 


f 


|c„ 


0 


0 


1 


a 


|o 




0 


1 


d 


|o 


0 


C33 


1 




L 






J 



= [C] (12) 
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Where C, C 22 and C 33 are set to the maximum possible pixel value. The transformation 
can be expressed as follows: 

[A][B] = [C] (13) 
Knowing [A] and [C], the B matrix can be determined by multiplying both sides of the 
5 equation (1 3) by the inverse of A: 

[A]- , [A][B] = [B] = [A]- , [C] (]4) 
The ,4 matrix can be inverted, provided that the selected pixels define independent axes. 
Once the B matrix has been determined, each RGB pixel value triad is multiplied by the 
B matrix to determine the new triad. The transformation may cause some grayvalues to 
1 0 be negative, so their absolute value is always used. The transformation may also cause 
grayvalues to exceed their maximum possible value. Accordingly, all of the new 
grayvalues are scaled so that the maximum gray value in the RGB image is equal to the 
maximum possible grayvalue. This completes the purification process. 

In terms of process steps, orthonormalization may be performed by: 
15 (1) Selecting at least two image regions in an initial image, each image region 
including at least one pixel, wherein the image regions define at least two distinguishable 
spectral categories. 

(2) Performing a color space transformation such as orthonormalization on the initial 
image, based on the color space coordinates of the pixels in each of the selected image 

20 regions, to generate a processed image. (If desired, orthonormalization may be performed 
serially on a dynamic series of initial images, or a series of acquired digitized images can 
all be corrected simultaneously). 

(3) Evaluating the processed image for a visible indication of an improved spatial 
distribution of color. The step of evaluating may be based on the improved spatial 

25 distribution of colors properly segregating to known standard targets, or the improved 
spatial distribution of colors segregating to biological structures. Preferably, a confocal 
microscope is used to perform such evaluation in order to observe three-dimensional 
spatial information. 
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The orthonormalization step is useful to cell biologists who may reiteratively select 
candidate pixels as representatives of the donor, acceptor, and FRET. This human 
intervention could be a key component in extracting data from images: the quality of the 
pixel selection would be evaluated by the resulting morphology of the pseudocolored 
5 image. For example, if FRET is observed within a particular structure after the spectral 
overlap correction, it might be advantageous to test various pixels within this structure 
by re-selecting candidate "red" pixels. 

These algorithmic methods (whether involving imaging or not) may be adaptable 10 flow 
cytometry (including imaging-in-flow methods) or sorting of cells in a flow system. 

1 0 Quantitative FRET Measurements 

In one embodiment, the quantitative method of the invention performs quantitative FRET 
measurements and analyses. FRET image data is obtained with standard filter sets in a 
fluorescence microscope. One set of equations for quantitative FRET is provided below 
(equations lSa-30). These equations are similar to or derived from FRET correction 

15 equations set forth in Gordon, et al, Quantitative Fluorescence Resonance Energy? 
Transfer Measurements Using Fluorescence Microscopy, Biophysical Journal, Vol. 74, 
May 1998 2702:2713, which is hereby incorporated by reference. The two and three 
letter symbols used in the equations have the following meanings: 
Aa is the signal from an acceptor-only specimen using the acceptor filter set; 

20 Dd is the signal from a donor-only specimen using the donor filter set; 
Fa is the signal from an acceptor-only specimen using the FRET filter set; 
Fd is the signal from the donor-only specimen using the FRET filter set; 
Ad is the signal from a donor-only specimen using the acceptor filter set; 
Da is the signal from an acceptor-only specimen using the donor filter set; 

25 Df is the signal from an 'acceptor plus donor' specimen using the donor filter set; 
Ff \s the signal from the 'acceptor plus donor' specimen using the FRET filter set; 
Af is the signal from an 'acceptor plus donor' specimen using the acceptor filter set; 
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Dfd refers to only the donor signal with the Donor filter set when both donor and 
acceptor are present; 

Dfa refers to only the acceptor signal with the Donor filter set when both donor and 
acceptor are present; 

5 Ffd refers to only the donor signal with the FRET filter set when both donor and acceptor 
are present; 

Ffa refers to only the acceptor signal with the FRET filter set when both donor and 
acceptor are present; 

Afd refers to only the donor signal with the Acceptor filter set when both donor and 
1 0 acceptor are present; 

Afa refers to' only the acceptor signal with the Acceptor filter set when both donor and 
acceptor are present; 

Dfd refers to the donor signal with the Donor filter set that would have been if no 
acceptor were present and therefore no FRET occurred; 
1 5 Afa refers to the acceptor signal with the Acceptor filter set that would have been if no 
donor were present and therefore no FRET occurred. 

The FRET symbols used in the following equations have the following meanings: 
FRET1 is the loss of donor signal due to FRET using Donor filter set in the method using 
three-filter sets; 

20 FRETN is the normalized measure of FRET equal to FRETl/(DfcT x Afa)\ 
FRET2 is equal to FRETJ/Dfd; 

FRET3 is equal to FRET J /(Dfd' x Afa), which equals FRETN; 

FRET4 is the loss of donor signal due to FRET using Donor filter set in the method using 
two-filter sets; 

25 G is the factor relating the loss of donor emission due to FRET in the Donor filter set to 
the gain of acceptor emission due to FRET in the FRET filter set. 
Note that in a two-filter system, the following substitutions may be made: 
Dd* is similar to Dc/but with acceptor concentration proportional to donor concentration; 
Fd' is similar to Fd but with acceptor concentration proportional to donor concentration; 

30 Ad'is similar to Ad but with acceptor concentration proportional to donor concentration; 
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Da • is similar to Da bui with acceptor concentration proportional to donor concentration; 
Fa ' is similar to Fa but with acceptor concentration proportional to donor concentration; 
Aa ' is similar XoAa but with acceptor concentration proportional to donor concentration. 

Additional corrections for P can be derived from equations 15a-30 below, where 
5 equation (1 0) is rewritten in the tenns defined above as equation (1 5): 

P = Ff- Df(FaVDd) - Af(Fa/Aa) (i 5 ) 

In particular, P can be (1) corrected for cross-talk resulting from detection of donor 
fluorescence through an acceptor emission channel and/or acceptor fluorescence through 
a donor emission channel (e.g., corrected for non-zero values of Ad and Da); (2) 

1 0 normalized for the concentration of a donor, preferably by applying a correction of 1 IDf; 
(3) normalized for the concentration of an acceptor, preferably by applying a correction 
of MAf\ (4) normalized for the concentration of a donor and an acceptor, preferably by 
applying a correction of \l(P/*Afr (5) corrected for cross-talk and normalized. In 
addition, the initial FRET image is improved with respect to photobleaching by using a 

1 5 sensitive camera and fast exposure times. 
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Df = Dfd + Dfa (15a) 

F/ = F/d + Ffa (15b) 

Af = Afd + Afa (15c) 

Df = Dfd + F/a(Da I Fa) (1 6a) 

Ff = Dfd{Fd I Dd) + Ffa (16b) 

Af = Dfd(Ad/Dd) + A/a (16c) 

Dfd = DJd-FR£T\ (17) 

Afa = A/h + G ■ FR£T\{Ad / Fd) (18a) 

G= 2£>AZ1 (18b) 

Ffa = ~Afh{Fal Aa)+G-FRET\ (19) 

Dfa = ~Afa{Dal Aa)+ G ■ FR£T\{Da I Fa) (20) 

iy = £>/tf - + 4/S(Da IAa)+G- FRET\{Da I Fa) (21 a) 

/J = (d/£ - FRETX^Fd I Dd) + ~Afb(Fa / Aa) + G ■ FRETl (21 b) 

Af = (d/# - FRETlJ^Ad I Dd)+ ~Afh + G • FRET\{Ad I Fd) (21 c) 

4/5- (22a) 

FRETX = F/ ~ / ^>P/ ~ Aja[{Fa /Aa)-(Fd/ Dd\Da I Aa)] 

G[\-{Da/ Fa\Fd/Dd)) 

Dfd = Df + FR£T\[\ - G{Da I Aa)) - Afa{Da I Aa) (22c) 
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FRETN = ™ E IL cc fe^l 



Dfd ■ Afa ^ [total d\ [total a) (23 ^ 
K cq = [bound ]/ ( [free d] ■ [free a] ) (24) 



FRETN = Ff " ^ ^ / D ^ ~ ' Aa) 

G-Df-Af 



(25) 



£>/ = Dfd - Dfd ■ FRET2 + Afa{Da I Aa)+G • ~Dfd ■ FRETl(Da I Fa) (26a) 

Ff = {5fd - DJd ■ FRETT^Fd I Dd ) + ~Afa{Fa !Aa)+G-Dfd- FRET2 (26b) 

Af = (Zya - • FRET2\Ad I Dd)+ ~Afa + G-~Dfd- FRET2(Ad I Fd) (26c) 
— _ Af-{AdlFd)Ff 

Af ° ~ \-[{Ad/FdlFalAa)} (27a) 

FRET2 = F f ~ 7 ~ 4fc[( Fa 1 Aa ) ~ i Fd 1 Dd\Da I A a)] 

Ff[\ - {Da I Fa)G]- Df[{Fd I Dd)- G) (27b) 

-A/h[{Fa/Aa)-(Fd/DdXDa/Aa)] 



FRETN = FRET2 1 Afa (28) 



Df = Dfd - Dfd ■ Afa • FRET3 + ~Afa{Da I Aa) + G-DJb-Afh- FRET3(Da I Fa) (29a) 

Ff = (iD/tf -Dfd- Afa- FRET3\Fd /Dd)+ Afh{Fa I Aa) + G -Dfd -A/a ■ FRET3 (29b) 

Af = fp/d - Dfd • A/b-FRET3\Ad I Dd) + ~Afh + G-~Dfd-~Afa- FRET3(Ad I Fd) (29c) 

FRETN = FRET3 = FRET2 1 ~AJh = FRETl I^Dfd ■ ~Afa) (30) 
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FRET Beads as Calibration Standards 

The invention provides a set of calibration targets, including a variety of "FRET Beads" 
applicable to widely-used FRET pairs. The invention also provides a method for imaging 
the FRET standards in a conventional three-channel (i.e., three-cube) epifluorescence 
5 microscope, and applying FRET calibration algorithms such that donor concentration 
[D] r acceptor concentration [A] ? and FRET efficiency (E) values can be determined on 
unknown samples. An advantage of using surfaces such as beads as FRET calibrants, 
rather than solution-based techniques, is that the use of surfaces such as beads eliminates 
unwanted interference by various physico-chemical phenomena, such as singlet-singlet 
1 0 annihilation. Other effects may accentuate FRET on surfaces as excitons are formed. 

In one embodiment, the invention provides FRET Beads with His-tagged GFP 
derivatives to Ni/NTA derivatized Sepharose beads at a surface concentration that is 
sufficiently high to achieve efficient FRET between donor and acceptor molecules, e.g., 
between blue-emitting (BFP) and green-emitting GFP derivatives. These FRET Beads 

15 provide a surface to associate (bind) these His-tagged proteins very tightly in aqueous 
solution (stable for months at A °C); however, protein dissociation and release from the 
bead can be accomplished immediately by the addition of imidazole. Release from the 
bead modulates the FRET properties of donor and acceptor molecules (i.e., FRET 
efficiency goes to zero). This treatment can be performed in the same fluorimeler 

20 cuvette; the difference in spectra taken before and after release is a direct indication of 
FRET efficiency. Previously, FRET parameters were extremely difficult to obtain; for 
example, artifacts can be generated by alternative procedures such as loading highly 
concentrated donor and acceptor solutions into microcapillaries. The invention of a 
FRET Bead with selective release makes these parameters trivial to measure. The simple 

25 procedure of adding 1 M imidazole enables accurate determination of donor and acceptor 
concentrations and efficiency, thereby furnishing the basis for calibration standards in 
quantitative FRET microscopy. These calibrated beads are used to determine instrument 
response and to standardize the epifluorescence microscope hardware and software for 
use with a variety of samples. 
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In one embodiment, the invention provides a series of FRET Beads bearing derivatives 
of the Green Fluorescent Protein that are of current interest to cell biology. These include 
a blue/green pair (380 nm excitation/5 1 0 nm emission) and a cyan/"yellow" pa i r (450 ran 
excitation/530 nm emission). 

5 Two derivatives of GFP are used for FRET standards, based on their spectral properties. 
The mutant BFP11, constructed by Lossau <?/ a/. (Chem. Physics. 213:1-16, 1996) using 
combinatorial mutagenesis, contains the mutations F64M/Y66H. BFP1 1 has blue-shifted 
excitation and emission maxima relative to wild-type GFP (Figure 2). The mutant 
RSGFP4 (Delagrave et al. 9 Bio/Technology, 13:151-154, 1995), generated by 
10 combinatorial mutagenesis, contains the mutations F64M/S65G/Q69L. RSGFP4 has 
spectral properties similar to the S65T mutant reported by Heim et al (Proc. Natl Acad. 
Sci. USA 91:12501-12504, 1994). As the acceptor in a FRET pair, both S65T and 
RSGFP4 are superior to other red-shifted excitation mutants such as RSGFP8 (F64L + 
S65T), because the latter mutant has significant excitation in the violet. 

1 5 Calibration values can be stored on a computer for future normalization and correction 
of samples that do not include calibration standards (i.e., pure donor, acceptor, or FRET 
Beads) in the same field of view. Once calibrated for a particular pair of fluorophores 
matched to a specific set of cubes within a defined optical bench, these normalization 
factors are stable and applicable to unknowns containing these fluorophores. 

20 FRET Beads provide a vehicle enabling one to relate a measured intensity of acceptor 
fluorescence sensitization to a corresponding amount of donor quenching. This 
calibration factor, X F , embodies not only instrument response but also the concept of a 
FRET quantum yield. X ¥ greatly simplifies the determination of the amount of donor 
performing FRET without the need to photodestruct or otherwise physically separate 

25 donor from acceptor. This calibration factor also compensates for differences in 
absorption cross-sections, excitation intensities, and detection efficiencies. 
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By combining the E value determined by conventional fluorimetry measurements of E 
and quantitative imaging, X F is derived from a FRET calibration bead: 
C 3 a d -E 6 V 

Cie E 0 (34) 

where C, is the intensity from the C, channel and C 3 * is the intensity from the Q FRET 
5 channel after spectral overlap corrections have been made using equation (38), below. 
This value can then be applied to the calculation of FRET parameters in sample 
unknowns. From equation (6), E is equivalent to determining the number of donors 
performing FRET, divided by the total number of donors. Since the Forster equations 
apply to a single donor-acceptor pair, the amount of donors performing FRET can be 
10 directly related to the measured sensitized acceptor emission. In the three-cube 
microscope system, E of FRET samples can be determined by incorporating the bead 
calibration factors (X D and X F ) and combining the C, and C 3 channel information as: 
Hi 



E = 



H * +H > (35) 

X X 
where F and D respectively. 

1 5 Thus equations (34) and (35), used in conjunction with FRET Beads, greatly facilitate 
the conversion of sensitized acceptor emission into units compatible with quenched 
donor emission, resulting in the ability to readily quantitate the amount of donor 
performing FRET, the total amount of donor, and the FRET efficiency. 

For the beads shown in FIG. 8, from the y-axis values, 1 D = 0.63 and J A = 0.24. The 
20 energy transfer efficiency E is determined by substituting into equation (6): 
E - 0.63 - 0.24 = 0.62 (/. e. t 62% efficient in energy transfer) 
0.63 
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Measurement of E enables the mean separaiion distance (r) between donor and acceptor 
to be calculated using another one of the Forster equations: 

(36) 

where R<, is the Forster radius or critical distance at which the efficiency of energy 
5 transfer is 50%. Rq can be determined using semiempirical methods and the following 
(see, equation (3)): 

R 0 = [8.79 x 1 0- 25 J(X)K 2 Q D n J, ] ,/6 (37) 

Parameters in equation (37) include J, the spectral overlap integral, which is graphically 
equivalent to the integrated area shared between the donor's fluorescence emission 

1 0 spectrum and the acceptor's ground state absorption spectrum, both normalized to unity. 
Other parameters include: Qd, the fluorescence quantum yield of the donor in the absence 
of acceptor; n, the index of refraction, which for a cellular system is typically (1 .3 - ] .4); 
k 2 , the dipole-dipole orientation factor. Considering the spectral overlap for the 
BFP1 1/RSGFP4 pair shown in FIG. 8, and random orientation factors, Rq is 

1 5 approximately 40 A. Substitution of Ra and E into equation (36) results in a separation 
distance r of 37 A between BFP1 1 and RSGFP4 on the FRET Beads described above. 
This BFP1 1-RSGFP4 distance is reasonable considering that the minimum possible 
distance between the fluorophores is -25 A, as indicated by the X-ray structure of the 
GFP dimer. 

20 The invention also provides a method to characterize (by conventional fluorimetry) a 
series of beads with controlled quantities of donor and acceptor molecules per unit 
surface area so as to generate standards with respect to donor concentration [D], acceptor 
concentration [A], and FRET efficiency (E). The determination of donor intensities in 
the presence (1 DA ) and absence ) of FRET, which are normalized for donor 

25 concentrations, is one of the major difficulties in performing quantitative FRET on 
biological samples. Imidazole mediates the release of the GFP fluorophores from the 
Ni/NTA-chelating bead to achieve this in essentially one step. 
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The existence of spectral overlap is noted by observing that each of the monochrome 
images shows more than one bead type. In the C 3 channel, spectral overlap is a result of 
bleed-through of the donor's emission tail into the acceptor emission band. In addition, 
direct excitation of the acceptor can occur at certain wavelengths (e.g., 370 nm) due to 
5 a small amount of acceptor absorbance at such wavelengths. Spectral corrections for the 
C 3 channel can be made by adapting equation (10) as follows: 

C 3 ' = C 3 - (C 3 D /C, D ) x C x - (C A /C 2 A ) x C 2 (38) 

where = the ratio of the FRET channel intensity to the Donor channel intensity 

for a "pure donor" pixel after background subtraction on each monochrome image, and 

10- = the ratio of the FRET channel intensity to the Acceptor channel intensity for 

a "pure acceptor" pixel after background subtraction on each monochrome image. 
Having derived the fluorophore surface concentrations from solution measurements (see, 
equation (40)), donor surface concentrations can be related to the donor emission 
intensity in C, images of pure donor beads via the following equation: 

15 ~ (39) 
where X D is defined as the donor calibration factor and has units of grayvalue per 
molecule per unit area. Likewise, the acceptor calibration factor, X A , can be determined 
from pure acceptor beads imaged through the C 2 channel. Since a three dimensional 
fluorophore-coated bead is projected onto a two-dimensional imaging surface, care must 

20 be taken in selecting pixels to be used for intensity (grayscale) measurements. Given the 
size and optical density of these beads, it is reasonable to base intensities on the center 
pixels of each bead and divide by a factor of 2. This is because looking down on a bead 
in the microscope, fluorescence (which is isotropic) is seen from both the bottom and the 
top of the bead surface due to the 3D to 2D projection. In determining X A and X D it is 

25 important to note that the fluorescence quantum yield and instrument response 
corrections are all embodied within this calibration factor. By constructing and 
characterizing a series of beads, the linearity of this relationship or the limits of the linear 
range are determined. 
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By cahbrating the instmmenu other factors that influence FRET intensity can be 
experi.enta.ly determined, , g , the interchromophore separation (r), the orientation 
factor (k»X and the FRET efficiency (E). These calibrations may enable the user to create 
•mages ,„ which the magnitude and spatial distribute of these coefficients are 
5 delayed. Values for the first two variables could be determined by adding, for example 
corrections for differences in absorption cross section between donor and acceptor and 
corrections for differences in excitation intensity and detector efficiency. Values for k : 
can be determined by using calibration standards containing chromophores with fixed 
orientations. 

1 0 Calibration and Test Samples 

In a typical analysis, three images using C„ C 2 , and C, are obtained for a calibration slide 
bearing a rmxture of pure donor, pure acceptor, and FRET beads. Fluorescent beads are 
atr-dned on the surface of a microscope slide for imaging. All images recorded used 
hght-mmus-dark subtraction to correct for a pedestal of dark counts. The calibration slide 
15 ,s then used to obtain the background-subtracted, spectral overlap correction ratios a, 
well as X A , X D , and X,. After these measurements are made, this slide is removed and 
replaced with a test sample from which three additional images are obtained under 
.denucal experiment conditions. Each of these monochrome images is background 
subtracted and the overlap corrections applied. The image-based microscope system 
20 performs massively parallel analysis on every pixel in the scene. For a 1000 X 1000 
resolution image, this is equivalent to 1 0< simultaneous sing.e spot measurement, Each 
Pixel can be processed to generate energy transfer efficiency according to equation (35) 
and distance distribution images according to equation (36), provided that R a is known 
[A] tmages can be determined from the ratio of the C 2 channel to X A , and [D] images can 
25 also be derived. 

Once the microscope is calibrated ft, a specific FRET pa.r, .he system remains calibrated 
for all other samples containing those types of fluorophores. Recalibration is required 
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only if the microscope's hardware is altered (e.g., changing an epi-cube) or if a different 
FRET pair is studied. 

Quantitation of FRET signals can be achieved by correlating measurements made in the 
MicroFRET device on beads or other targets with conventional measurements made in 
5 a fluorimeter. For example, imidazole release of fluorophores from the beads within a 
cuvette can be used to quantify total donor and acceptor, as described in EXAMPLE 2. 

Computer Implementation 

The MicroFRET system provides digital imaging spectroscopy (DIS) software that 
supports algebraic manipulation of images for correcting bleed-through of donor 
10 emission into the acceptor channel and for correcting excitation of the acceptor at the 
donor excitation wavelength, as well as for creating a new RGB axis-set to highlight 
donor, acceptor, and FRET pixels. The system also provides image processing and 
display for both 1 6-bit monochrome images and 24-bit RGB images. 

Correction for spectral overlap was performed as follows: The ratio of the FRET channel 
1 5 intensity to the donor channel intensity is determined for a "pure donor" pixel after 
background correction. The ratio of the FRET channel intensity to the acceptor channel 
intensity is also determined for a "pure acceptor" pixel after background correction. 
These ratios are then used to correct the FRET channel values using equation (10) for 
each pixel. After a grayvalue image has been obtained for each of the three channels, the 
20 three measurements are reassembled into a composite RGB image. However, even 
though the correction factors for spectral overlap have been calculated for each of the 
three channels, the various donor, acceptor and FRET beads do not necessarily appear 
aspure blue, green and red, respectively, because the colors displayed in the initial RGB 
image have not yet been orthonormalized. MicroFRET allows the user to correct this 
25 problem by permitting a user to select pixels that contain the most red, green and blue 
from the overlap-corrected RGB image. The program mathematically transforms the 
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image to a color system in which the red, green and blue axes are defined by the red, 
green and blue grayvalues for the pixels that have been selected (FIG. 4). 

More particularly, the algorithm that is used in MicroFRET transforms an RGB image 
from the red, green and blue color system into a color system defined by three user- 
5 defined RGB triads. A composite RGB image has already been described in FIG. 3, and 
reproduced as panel A in FIG. 5. The FIG. 5 panels are magnified so that only the upper 
left quadrant of the FIG. 3 image is shown. Steps in the bleed correction and the 
orthonormalization of the uncorrected RGB image shown in FIG. 5 (panels A - F) 
proceed as follows: 

1 0 Panel 5A - RGB. The monochrome images from FIG. 3 were combined to generate panel 
5 A using images shown in windows Dl, Al, and Fl for the blue, green, and red 
channels, respectively. The color intensity range for all three color channels is based on 
the minimum and maximum pixel values of the combined three-image set. 

Panel 5B- Scaling corrections. Fluorescence signal intensities among the three channels 
1 5 can vary due to quantum yield and extinction coefficient differences between donor and 
acceptor. Signal strength is also dependent on instrument parameters such as illumination 
intensities of the light source and detector sensitivity at different wavelengths. If the 
range of pixel values differs significantly between channels, the color of the channel with 
the highest pixel value readings can overwhelm the color of the channel with lower pixel 
20 value readings. Panel 5B shows the pseudocolor image after individually rescaling the 
color intensity of each of the three channels to its minimum and maximum pixel values. 

Panel 5C - Background correction. Panel 5C shows the pseudocolor image after each 
pixel has been corrected for background signals. MicroFRET software prompts the user 
to select the position of five background pixels by clicking on the image. These pixel 
25 values are averaged and automatically subtracted. If any of the subtracted values are 
negative, they are set to zero. 
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Panel 5D - Spectral overlap corrections. The data represented in FIG. 3 showed that 
there is significant spectra) overlap among the epi fluorescence images. However, because 
the epifluorescence cubes in the MicroFRET instrument maintain precise image 
registration, the contaminating contributions to the FRET image (and the other images) 
5 can be subtracted from all of the pixels. For the FRET channel, this correction is 
performed according to equation (10) which minimizes donor and acceptor bead pixel 
values in the FRET channel so that they approach zero. Only pixels from beads 
performing FRET maintain significant signal intensity in this channel (red) after 
correction. Panel 5D shows the pseudocolored image after this overlap correction. The 
1 0 "red contribution" from the pure donor and pure acceptor beads has been removed. The 
donor beads now appear blue instead of purple and the acceptor beads now appear as 
green. 

Panel 5E - Highlighting FRET. To further demonstrate the correction for spectral 
overlap, the green and blue channels are turned off in the bleed-corrected image. This 
1 5 simplifies the identification of the "red" pixels where FRET is taking place. This process 
is easily performed in real-time using a simple tabbed dialog box in which each tab 
allows the user to selectively contrast enhance a particular channel. As can be seen in 
panel 5E, only red beads corresponding to FRET are observed. 

Panel 5F. Orthonormalization. To enable identification of areas in the sample which 
20 contain donor, acceptor, or FRET emission, the software can pseudocolor the image 
based on user-defined criteria. By clicking the computer mouse on pixels representing 
each of the three types of beads (i.e., donor, acceptor, and FRET) in panel 5D, the user 
can reset the color assignments to display corrected emission from the donor to pure blue, 
the acceptor to pure green, and FRET to pure red (panel 5F). 
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Computer implementation of this aspect of the invention can be summarized as follows: 

1 . Select 3 epifluorescence cubes optimized for Donor, Acceptor, and FRET channels. 

2. Optically align cubes to within ] pixel resolution; if using OCA devices, apply 
run-time software acquisition loop to fluorescent bead visible in all three channels 

5 to achieve alignment. 

3. Combine images acquired through the three cubes into one RGB image. 

4. Either skip to step 9 or perform steps 5-8. 

5. Orthonormalize the RGB image by selecting pixels representative of donor : acceptor, 
and FRET pixels. 

1 0 6. Repeat step 5 if choice of candidate pixels yields poor mapping of color to either 
biological morphology or standards. 

7. Optionally, save orthonormalization template for application to subsequent images. 

8. Contrast enhance R, G, and B in the orthonormalized RGB image. END. 

9. Correct the RGB image for background. 

15 10. Further correct for spectral overlap according to equations related to F c . 

1 1 . Contrast enhance R, G, and B in the corrected RGB image. 

12. Optionally, perform steps 5,6,7,8. 

Aspects of the invention may be implemented in hardware or software, or a combination 
of both. However, preferably, the algorithms and processes of the invention are 

20 implemented in one or more computer programs executing on programmable computers 
each comprising at least one processor, at least one data storage system (including 
volatile and non-volatile memory and/or storage elements), at least one input device, and 
at least one output device. Program code is applied to input data to perform the functions 
described herein and generate output information. The output information is applied to 

25 one or more output devices, in known fashion. 

Each program may be implemented in any desired computer language (including 
machine, assembly, high level procedural, or object oriented programming languages) 
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to communicate with a computer system. In any case, the language may be a compiled 
or interpreted language. 

Each such computer program is preferably stored on a storage media or device (e.g., 
ROM, CD-ROM, tape, or magnetic diskette) readable by a general or special purpose 
5 programmable computer, for configuring and operating the computer when the storage 
media or device is read by the computer to perform the procedures described herein. The 
inventive system may also be considered to be implemented as a computer-readable 
storage medium, configured with a computer program, where the storage medium so 
configured causes a computer to operate in a specific and predefined manner to perform 
1 0 the functions described herein. 

Examples 

The capabilities of the MicroFRET device are demonstrated in the EXAMPLES by 
employing a pair of two widely used fluorescent protein tags. A wider range of 
applications for this instrument in cell biology studies are possible as more GFP variants 

1 5 with shifted excitation and emission spectra are constructed. Other fluorescent molecules 
and fluorophores besides GFP derivatives can be analyzed in this instrument by simply 
choosing an appropriate set of epifluorescence cubes, wherein the donor, acceptor and 
FRET cubes are designed to separate these signals based on their excitation and emission 
spectra. Furthermore, this system could also be used with non-protein chromophores such 

20 as organic dyes or lanthanide metals, or with combinations of all of these types. 

The technique of specific fluorophore-to-bead coupling can be extended to include other 
chemistries that do not rely on agarose beads, His-tagging, nickel derivatization, or 
fluorescent proteins. Thus, the beads can have two organic molecules acting as the FRET 
pair {e.g., fluorescein and rhodamine) while maintaining the ability to selectively release 
25 the fluorophores into solution. 
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Accordingly, the following EXAMPLES are illustrative and are not intended to limit the 
scope of the present invention. 



EXAMPLE T 
FLUORESCENT PROTEINS AND BEADS 

5 This EXAMPLE outlines a procedure to fabricate FRET calibration standards. This 
involved the synthesis of three types of beads: pure donor; pure acceptor; and FRET 
beads bearing both donor and acceptor molecules. Each bead type was synthesized as a 
series, where the values of [D], [A], and E were varied. To construct this series of beads 
a Ni/NTA-competitive binder («S», for spacer) that is His-tagged and has a similar size' 

1 0 and shape as the donor and the acceptor was used. In the case of GFP derivatives, several 
nonfluorescent mutants have been engineered which exhibit a "null- fluorescence 
phenotype, but nonetheless express large quantities of protein deficient i„ chromophore 
(e.g., point mutation R96M). Such His-tagged derivatives make excellent spacers on the 
surface of the Ni/NTA beads amongst other spectrally active GFP derivatives. The beads 

15 can be loaded with protein solutions systematically varied in D, A, and S. 

GFP-adsorbed bead standards were prepared using the following procedure. To facilitate 
protein purification and later attachment on Ni-Sepharose beads, BFP1 L RSGFP4, and 
the R96M variant were engineered to include His 6 tags on their amino-termini. -The 
mutant BFP1 1, constructed using combinatorial mutagenesis, contains the mutations 

20 F64M/Y66H (Lossau et al, Chen,. Physics. 213:1-16, 1996) and is similar to the mutant 
of Heim et al. (Proc. Natl. Acad. Sci. USA 91:12501-12504, 1994). It has blue-shifted 
excitation and emission maxima relative to wild-type GFP (FIG. 2 and TABLE 2 infra) 
The mutant RSGFP4, generated by combinatorial mutagenesis by Delagrave et al. 
(Bio/Technology, 13:151-154, 1995), contained the mutations F64M/S65G/Q69L. 

25 RSGFP4 has spectral properties similar to the S65T mutant also reported by Heim et al. 
(Proc. Natl. Acad. Sci. USA 91:12501-12504, 1994). As the acceptor in a FRET pair 
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both S65T and RSGFP4 are superior to other red-shifted excitation mutants such as 
RSGFP8 (F64L + S65T) ? because the latter mutant has significant excitation in the violet. 

The proteins were expressed in E. coli strain BL21(DE3), grown for 24 hours, ruptured 
in a French press, applied to a Novagen HisBind purification column, eluted in 1 M 
5 imidazole, and dialyzed. The final protein concentration was determined by a Bradford 
assay (Bio-Rad). An SDS-PAGE gel was run to confirm the purity and size of the 
dialyzed fraction (data not shown). Fluorescence excitation and emission spectra were 
recorded on a Photon Technology QM-1 fluorimeter. 

HiTrap metal chelating Sepharose beads are charged according to the manufacturer's 
1 0 (Pharmacia Biotech) instructions by washing the beads with 50 mM NiS0 4 . The beads 
are then washed extensively with 50 mM Tris-HCl (pH 8.0) to remove traces of 
uncomplexed nickel ions. A solution is made of purified proteins at a total protein 
concentration of approximately 0.4 mg ml" 1 in 50 mM Tris-HCl buffer. This dilute 
concentration is used to avoid GFP dimer formation in solution. 1.5 ml of this mixture 
1 5 is added to 50 jil of a bead slurry and incubated on ice for 1 hour with frequent mixing. 

Excess protein ensures that the beads are fully loaded. To remove nonspecifically bound 
protein (if any) the suspension is washed twice with a buffer containing 5 mM imidazole. 
0.5M NaCl and 20 mM Tris-HCl, followed by one wash with 50 mM Tris-HCl. All 
washes are done by centrifiiging the beads at 1,000 x g for 30 sees, in a microcentrifuge 
20 and resuspending the pellet in the appropriate buffer. The mean particle size of the beads 
is approximately 34 |im. 

FIG. 6 shows the surface of the chelating bead, as represented by a horizontal black line, 
with GFP donors and acceptors {e.g., BFP and RSGFP) shown as blue and green vertical 
lines, respectively. Six different types of possible interactions are labeled A-F. In this 
25 drawing, only adjacent molecules are considered to be within an efficient FRET distance. 
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The most heavily loaded beads were produced (under saturating conditions) to have 
optical densities under 0.1; therefore, photon-mediated trivial energy transfer or 
reabsorption do not have to be considered. In addition, the bead size is sufficiently large 
that surface resonance effects can be ignored. 

5 EXAMPLE 2 

CONVENTIONAL FLUORIMETRY 
ON THE GFP-LABELED FRET BEADS 

To confirm that the fluorescence emission from the FRET bead is actually FRET, as well 
as to ensure that the spectral properties of the two GFP variants have not changed as a 

1 0 result of binding to the Sepharose beads, a sample of each type of bead was treated with 
imidazole, which releases the protein. Fluorescence emission spectra for the FRET beads 
are shown in FIG. 2 and 8. The thick line of the B panels shows the emission spectrum 
of a suspension of FRET beads excited at 370 nm. The thin line of the B panels shows 
the emission spectrum of the same beads after both RSGFP8 and BFP-1 1 have been 

1 5 released from the beads by treatment with imidazole. The decreased donor emission and 
enhanced acceptor emission are characteristic of FRET. This effect is reversed when the 
two proteins are released from the beads. 

To determine [D] and [A] for each bead in a series, the concentrations of donor and 
acceptor were first measured in solution after release by treating with imidazole. This is 

20 best performed spectroscopically using known extinction coefficients or against known 
standards, since it is not possible to distinguish D, A and S with simple protein assays. 
The surface concentration of S is unimportant, because it is being used simply as a spacer 
and has no spectral properties in terms of visible absorption or fluorescence. After 
correcting for the increase in volume attributable to the addition of the imidazole 

25 (typically a factor of 1.25 x after adding a 1/4 volume of a 5 M solution), surface 
concentrations of donor molecules on pure donor beads can be determined from the 
following: 
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J£)J [-^^Released in solution 



IBW 2 (40 ) 

where d is the bead diameter which is given by the manufacturer, or alternatively 
measured using a stage micrometer and known magnification factors. Bead concentration 
([5]) in units of particles per ml, can be determined very accurately using a cell sorter. 
5 This has already been performed for three bead slurries, which were constructed under 
saturating fluorophore conditions. Fluorophore concentration measurements can be made 
for the pure acceptor and FRET beads using equations similar to equation (40). In the 
case of FRET beads, total donor and total acceptor concentrations can be determined 
after release. 

10 EXAMPLE 3 

DATA ACQUISITION FOR GFP -LABELED BEADS 

FIG. 3 shows a set of monochrome images obtained for a mixture of labeled Sephadex 
beads. Individual beads were coated with either (1) BFP-1 1 alone (donor beads), (2) 
RSGFP8 alone (acceptor beads) or (3) a 2:1 mixture of donor and acceptor (FRET 

15 beads). FIG. 3, lower right, shows the intensity of fluorescence emitted by all of the 
beads in the donor emission channel when excited by light corresponding to the donor's 
excitation spectrum. FIG, 3, lower left, shows the fluorescence emitted by the same beads 
in the acceptor channel when excited by light corresponding to the acceptor's absorption 
spectrum. FIG. 3, upper right, (the "FRET" channel) shows the fluorescence emitted in 

20 the acceptor channel when excited by light corresponding to the donor's excitation 
spectrum. The results from these monochrome images are displayed together in a 
pseudocolor image, with the fluorescence signal from the donor channel assigned the 
color blue, the signal from the acceptor channel assigned the color green, and the signal 
from the FRET channel assigned the color red (FIG. 3, upper left). In this image, the 

25 color intensities in each of the three channels are scaled to the pixel (from any of the 
three channels) with the highest grayvalue (DEFAULT setting). The FRET beads appear 
gold because these beads have fluorescence contributions in all three channels. The pure 
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donor beads appear purple (blue-red) because these beads have fluorescence 
contnbutions from the donor (blue) and FRET (red) channels. The pure acceptor beads 
appear mostly green with a slight reddish color because these beads have fluorescence 
contnbut.ons from the acceptor (green) and FRET (red) channels. It is evident from these 
5 .mages that there is significant bleed-through of both donor and acceptor emission into 
the FRET channel. 

EXAMPI,F.4 

IMAGE ACQUISITION OF GFP-LABELED BEADS 

Three monochrome images were acquired using the set of three epifluorescence cubes 
10 (see, TABLE V to image a mixture of three different types of fluorescent beads 
(described in TABLE 2). The epifluorescence cubes and bead types are labe,ed Donor 
Acceptor, and FRET to emphasize that the cubes and beads are spectrally matched The 
donor bead carries a GFP derivative (BFP1 ,) with an excitation maximum m the ,on g 
wave UV and emission in the blue. The acceptor bead carries RSGFP4, which is excited 

15 maximally in the cyan and fluoresces in the green. These excitation and emission 
wavelengths are matched to the donor and acceptor cubes. The FRET bead carr.es both 
the blue and green GFP derivatives, and the corresponding FRET cube is optimized to 
excite the blue donor and image the green acceptor after energy transfer has occurred 
Images acquired using the Donor, Acceptor, and FRET cubes are referred to as the Dl, 

20 A 1, and Fl images, respectively. 



25 



TABLE 2 ~~ 

Spectral characteristics of fluorescent beads used in this work. Wavelengths (nm) are 
given as 1^. 



Bead / Derivative 



Donor /BFPl ] 



Acceptor/ RSGFP4 



Excitation 

380 



490 




Emission 



445 
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Spectral mixing among the donor, acceptor, and FRET beads can be observed in the 
spatially coregistered monochrome and RGB images of FIG. 3. In the Dl image, the 
donor beads are the brightest, but dimmer FRET beads are also observed. In the Al 
image, the acceptor beads are the brightest, but dimmer FRET beads are also observed. 
5 In the Fl image, the FRET beads are the brightest, but dimmer donor beads are observed. 
This is consistent with the fluorescence spectra shown in FIG. 2 and the parameters given 
in TABLE 2. The pseudocolored, upper left image (RGB1) in Fig. 3 is the result of 
encoding the pixel values of each of these monochrome images into an intensity value 
for each of the red, green and blue components of the image. Fl is loaded into the red 
10 color channel, Al is loaded into the green color channel and Dl is loaded into the blue 
color channel. Because of spectral overlap, the various bead types are not visually 
distinct or well defined in this RGB image. 

Careful observation of the emission spectra of the donor and the acceptor shows that 
there is no wavelength at which the two fluorophores can be separated. For example, the 
1 5 use of a very narrow bandpass emission filter at 550 nm would not only fail to separate 
the two fluorophore's emissions, but it would also result in the loss of most of the 
microscope's light gathering ability. Using higher intensity illumination to compensate 
for this loss is likely to result in photobleaching. In contrast the invention uses broad- 
band emission filters and a relatively low intensity excitation source. 

20 EXAMPLE 5 

COLOR-CODED IMAGES OF BACULO VIRUS-INFECTED Sf9 CELLS 

Baculovirus-infected Sf9 cells expressing BFP11, RSGFP4, and a BFP1 1/RSGFP4 
fusion protein were tested (as shown in FIG. 7). After proper calibration of the system 
using FRET Beads, the [D] values are equal to zero in the RSGFP4-infected cells, and 
25 [A] values are equal to zero in the BFP1 1 -infected cells. FRET efficiencies in the 
BFP1 1/RSGFP4 fiision-protein-infected cells are equal to or less than the efficiency for 
the isolated fusion protein measured in solution, depending on the extent of proteolysis. 
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The extent of photobleaching and photoisomerization is less than 5%, as previously 
measured for the MicroFRET system using similar cubes, light sources, and CCD 
cameras. 

EXAMPLE 6 

5 MEASUREMENT OF DONOR PHOTOBLEACHING 

Steady-state FRET imaging of cells by sensitized emission using conventional 
microscopy has previously suffered from an inability to correct for spectral overlap while 
maintaining spatial co-registration. Until now, the three epi fluorescence cubes (donor, 
acceptor and FRET) that must be used to generate the correction values have been 

10 manufactured with optical surfaces that are not strictly parallel. This defect created 
geometric distortions in the image {i.e., displacement of pixels) after the images were 
combined. The MicroFRET instrument employs epifluorescence cubes which have been 
machined to precise tolerances, so that spatial co-registration is maintained for all of the 
images. This design also makes it feasible to detect relatively small amounts of FRET 

1 5 within a given pixel because the mathematical correction is much simpler (and therefore 
more accurate) than was previously possible. 

The effectiveness of these corrections was demonstrated by obtaining images of 
Sepharose beads loaded with either BFP-1 1, RSGFP4 or a defined mixture of the two 
(which is known to generate FRET). By using these beads as calibration standards, 
20 spectral overlap was corrected for and features identified within the image displaying 
donor emission, acceptor emission and donor-sensitized acceptor emission (FRET). By 
subsequently applying the orthonormalization algorithm ("pixel purification"), the pure 
donor, pure acceptor and FRET beads were pseudocolored as blue, green and red. 
respectively. 

25 Another concern in using the sensitized emission technique has been that the exciting 
light can photobleach the donor and thereby reduce the apparent intensity of the FRET 
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signal. The sensitized emission technique does not reduce the FRET signal by more than 
5% when using the method of the invention. Photobleaching is not a major problem 
because the high sensitivity of the K7 camera makes long exposures unnecessary. The 
grayscale iniensities of the fluorescent signals in the experiments, for example, used 
5 approximately 1/3 of the total dynamic range of the camera (maximum = 65535 bits). 

Nevertheless, under these exposure conditions, less than 5% of the donor signal was 
photobleached. The exposure time could easily be reduced by a factor of 10 and still 
allow the signal to be detected. 

The maximum extent of photobleaching of the BFP-11 donor during a FRET 
1 0 measurement was determined by monitoring the intensity of fluorescence emission from 
a sample of donor beads which were repeatedly given 30 sec. exposures to the exciting 
light. The mean grayscale value was determined for ten randomly selected pixels after 
multiple exposures, and these values were compared to the values for the same beads 
after the initial 30 sec. exposure. The measured intensity of the fluorescence emission 
1 5 after repeated exposure to the exciting light was >95% of the initial level. 

EXAMPLE 7 
QUANTITATIVE FRET MICROSCOPY 

The purpose of this EXAMPLE is to show that it is feasible to perform quantitative 
FRET microscopy by determining the donor concentration, acceptor concentration, 
20 energy transfer efficiency, and distance parameters between donor and acceptor 
molecules for every pixel in a microscopic field of view. 

Quantitative Imaging was performed using an Olympus AX70 epifluorescence 
microscope equipped with three cubes matched to the excitation and emission spectra of 
the GFP derivatives (TABLE 3). These cubes were spatially coregistered to single-pixel 
25 accuracy. Images taken with each cube form the input of three channels, which were used 
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for subsequent image processing. The C, channel was designed to selectively excite and 
image donor emission, the C 2 channel was designed to selectively excite and image 
acceptor emission and the C 3 channel was designed to visualize FRET, since excitation 
was at the donor excitation and imaged at the acceptor emission. 



10 



TABLE 3 

Spectra] characteristics of epifluorescence cubes used for BFP1 1/RSGFP4. Wavelengths 
(nm) are given as cut-on and cut-off (50% peak transmission) for excitation and 
emission filters and as the inflection point for dichroic filters. 



Cube 


Excitation (nm) 


Dichroic (nm) 


Emission (nm) 


Donor (BFP1 1) 


335 -380 


410 


435 - 490 


Acceptor (RSGFP4) 


450-490 


495 


505 - 550 


FRET 


335 -380 


410 


505 - 550 



EXAMPLE 8 

ORTHONORMAL1ZATION OF CHROMOGEN1C DYES 



1 5 Color space transformation algorithms are useful for rapidly identifying and highlighting 
groups of pixels or features in images which have very subtle or overlapping color 
difference. For example. FIG. 9 shows hematoxylin and eosin (H&E) slides of stained 
thin sections of cardiac tissue including an infarct. The left panel shows the true-color 
image generated by combining three separate monochrome images at 450, 550, and 650 

20 nm of the H&E stained tissue. The right panel shows this image after orthonormalization. 
In this particular case, candidate pixels for the orthonormalization were picked from 
nuclei, light-colored eosin, and dark colored eosin-containing regions as R, G, and B. 
respectively. The resultant image shows two distinct types of eosinophilic tissue. Such 
differentiation in staining by eosin is difficult to see in non-enhanced images. Subtle 

25 color differences in eosin may correlate with various disease states such as the presence 
of collagen in tissues. The enhanced image has been further enhanced by contrast 
enhancement of each separate R, G, and B color channel. 
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EXAMPLE 9 
CORRECTIONS IN TIME-COURSE IMAGERY 

Candidate pixels or features that are used to calculate the color space coordinates of the 
refined image can be selected from a sequence of spatially coregistered images which 

5 might, for example, involve a time sequence of events. In this embodiment, a series of 
images would be displayed within a window with 'stop', 'start', 'forward' and 'time- 
delay 5 parameters. While the sequence of images might have been obtained over a very 
fast time course (video rates; milliseconds per frame), the player would enable the end 
user to slow down the visualization process to the extent that candidate pixels would be 

10 picked as the basis for the color space transformation. Coefficients to these specific 
transformations would be applied to all frames in the image sequence: the heuristics of 
a user-desired morphology would utilize a graphical user interface to evaluate whether 
the candidate pixels were a pood pick. This method may be very important in ratio-metric 
dynamic imaging of live cells, wherein movements of protein, ions, and other cellular 

15 components are reported through fluorescence and FRET. Other evaluation criteria for 
determining whether the candidate pixels were properly chosen include the segregation 
of colors onto known standard targets. 

The mathematical coefficients determined during the conversion of an unprocessed to 
processed image utilizing an image containing known standards, can be saved and 
20 applied to an image containing no standards. This standardization template can be 
recalled and the coefficients used to correct subsequent images taken under similar 
conditions of illumination, optical filtration and recording. 
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A number of embodiments of the present invention have been described. Nevertheless, 
it will be understood that various modifications may be made without departing from the 
spirit and scope of the invention. For example, the invention described above is clearly 
not limited to FRET analyses of GFP derivatives on specific beads, but these experiments 
5 do demonstrate a reduction to practice of an imaging spectrophotometer and methods 
capable of detecting FRET. Accordingly, other embodiments are within the scope of the 
following claims. 
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WHAT IS CLAIMED IS: 

1. A method for transforming an initial image of biological material to a processed 
image, the initial image being represented by a set of pixels each having three color 
space coordinates, the method including the sieps of: 

5 (a) selecting at least two image regions in the initial image, each image region 
including at least one pixel, wherein the image regions define at least two 
distinguishable spectral categories; 

(b) performing a color space transformation on the initial image, based on the color 
space coordinates of the pixels in each of the selected image regions, to generate 

10 a processed image; and 

(c) evaluating the processed image for a visible indication of an improved spatial 
distribution of color. 

2. The method of claim 1, where the color space transformation is an 
orthononnalization transformation, wherein grayvalues of selected pixels are used 

15 to construct the matrix 

r n 
|a h a ]2 a, 3 | 

| A 2 , A 22 A 23 | 
|A 31 A 32 A 33 [ =[A] " 
20 L J 

which is transformed to the matrix 

r *i 
|c„ 0 0 | 
|o c 22 o I 

25 |0 0 C 33 | =[C]. 

L J 

3. The method of claim 1, where the color space transformation is a spectral overlap 
correction. 
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4. The method of claim L where the color space transformation is a spectral overlap 
correction of the form: 

5 . The method of claim 1 , where the image regions include substances that absorb light. 
5 6. The method of claim 1 s where the image regions include substances that fluoresce. 

7. The method of claim 1. where at least one image region includes a substance that 
exhibits FRET 

8. The method of claim 1, where the step of evaluating is based on the improved spatial 
distribution of colors properly segregating to known standard targets. 

10 9. The method of claim 1, where the step of evaluating is based on the improved spatial 
distribution of colors segregating to biological structures. 

10. The method of claim 1, wherein the method for transforming includes using a 
dynamic series of initial images. 

11. The method of claim 1, wherein the step of evaluating includes using a confocal 
15 microscope. 

12. The method of claim 1 , wherein the image is within a series of images all corrected 
simultaneously. 

13. The method of claim 1 5 wherein the step of evaluating includes using a set of 
calibration targets. 

20 14. The method of claim 1 , wherein the image is of a stained thin section of tissue. 
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1 5. A FRET standard, carrying both donor and acceptor molecules, with known FRET 
properties used to a calibrate an optical instrument to enable FRET measurements. 

1 6. The FRET standard of claim 1 5, where the FRET property is efficiency E. 

17. The FRET standard of claim 15 r where the FRET standard relates a measured 
5 intensity of acceptor fluorescence sensitization to a corresponding amount of donor 

quenching according to: 

C 3 a d- g p - 
H e £> 0 



18. The FRET standard of claim 15 r where the FRET properties are modulated by 
association and dissociation of the donor and the acceptor molecules. 

10 19. The FRET standard of claim 15. where the FRET properties of the standard are 
determined by modulating the association and dissociation of the donor and the 
acceptor molecules. 

20. The FRET standard of claim 15. where the FRET efficiency of the standard is 
determined by modulating the association and dissociation of the donor and the 

1 5 acceptor molecules. 

21. The FRET standard of claim 15, where binding of donor and acceptor molecules to 
the set of FRET calibration targets is reversible. 

22. The FRET standard of claim 15, where the donor and acceptor molecules are 
fluorescent proteins. 

20 23. The FRET standard of claim 15 ? where the FRET standard includes at least one 
fluorescent substance bound to a microscopic bead. 
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24. A method for transforming an iniiial FRET image to a processed FRET image, the 
initial image being represented by a set of pixels each having three color space 
coordinates, the method includinp the steps of: 

(a) generating a corrected FRET image from an initial image by correcting for 
5 spectral overlap by applying a transformation of the form to obtain a corrected 

FRET channel image F c : 

F c =F b -fclD b d ) D»-(tf/A b a ) A\ 

(b) selecting at least two image regions in the corrected FRET image, each image 
region including at least one pixel, wherein the image regions define at least two 

10 distinguishable spectral categories; 

(c) performing a color space transformation on the corrected image, based on the 
color space coordinates of the pixels in each of the selected image regions, to 
generate a processed image; and 

(d) evaluating the processed imape for a visible indication of an improved spatial 
1 5 distribution of color. 

25. The method of claim 24, including the step of further correcting the corrected FRET 
image for cross-talk resulting from detection of donor fluorescence through an 
acceptor emission channel and detection of acceptor fluorescence through a donor 
emission channel. 

20 26. The method of claim 24, includinp the step of further correcting the corrected FRET 
image for non-zero values of Ad. a signal from a donor-only specimen using an 
acceptor filter set, and Da, a signal from a acceptor-only specimen using a donor 
filter set. 

27. The method of claim 24, includinp the step of further correcting the corrected FRET 
25 channel image F c by normalizing for the concentration of a donor. 
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28. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c . so as to be approximately normalized for the concentration of a 
donor, by applying a correction of VDf, where Df \s a signal generated through a 
donor filter set when both donors and acceptors are present in the biological material. 

5 29. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of an acceptor. 

30. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c , so as to be approximately normalized for the concentration of a 
acceptor, by applying a correction of \/Af 9 where Afxs a signal generated through an 

10 acceptor filter set when both donors and acceptors are present in the biological 
material. 

3 1 . The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of both a donor and an 
acceptor. 

1 5 32. The method of claim 24, including the step of further correcting the corrected FRET 
channel image P. so as to be approximately normalized for the concentration of both 
a donor and an acceptor, by applying a correction of l/(Df *Af) 7 where Df is a signal 
generated through a donor filter set when both donors and acceptors are present, and 
Af is a signal generated through an acceptor filter set when both donors and acceptors 

20 are present. 

33. The method of claim 24, including the step of further correcting the corrected FRET 
image by correcting for cross-talk resulting from detection of donor fluorescence 
through an acceptor emission channel and detection of acceptor fluorescence through 
a donor emission channel, and by normalizing for the concentration of both a donor 
25 and an acceptor. 
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34. The method of claim 24, wherein the initial FRET image has less than about 5% 
photobleaching. 

35. An optical instrument for measuring FRET which is calibrated with a FRET standard 
having donoi molecules and acceptor molecules and that relates a measured intensity 

5 of acceptor molecule fluorescence sensitization to a corresponding amount of donor 
molecule quenching. 

36. The optical instrument of claim 35 : wherein a FRET standard, carrying both donor 
and acceptor molecules with known FRET properties, is used to a calibrate an optical 
instrument 10 enable FRET measurements. 

10 37. The optical instrument of claim 35, wherein the FRET measurements can be 
processed to yield a FRET efficiency E. 

38. The optical instrument of claim 35, wherein the FRET measurements can be further 
processed to yield a distance r separating the donor and acceptor molecules. 

39. The optical instrument of claim 35, wherein the filters within the epifluorescence 
1 5 cubes have been selected based on their optical surfaces having no more than 1 5 arc 

seconds of wedge parallelism and no more than 10 waves flatness. 
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40. A computer program, residing on a computer-readable medium, for transforming an 
initial image of biological material to a processed image, the initial image being 
represented by a set of pixels each having three color space coordinates, the computer 
program comprising instructions for causing a computer to: 
5 (a) select at least two image regions in the initial image, each image region 
including at least one pixel, wherein the image regions define at least two 
distinguishable spectral categories; 

(b) perform a color space transformation on the initial image, based on the color 
space coordinates of the pixels in each of the selected image regions, to generate 

1 0 a processed image; and 

(c) evaluate the processed image for a visible indication of an improved spatial 
distribution of color. 



4 1 . A computer program, residing on a computer-readable medium, for transforming an 
initial FRET image to a processed FRET image, the initial image being represented 
by a set of pixels each having three color space coordinates, the computer program 
comprising instructions for causing a computer to: 

(a) generate a corrected FRET image from an initial image by correcting for 
spectral overlap by applying a transformation of the form to obtain a corrected 
FRET channel image T°: 

F c =F b -(ft/D b d ) D»-(F 0 b /A b 0 ) A b . 

5 

(b) select at least two image regions in the corrected FRET image, each image 
region including at least one pixel, wherein the image regions define at least two 
distinguishable spectral categories; 

(c) perform a color space transformation on the corrected image, based on the color 
space coordinates of the pixels in each of the selected image regions, to generate 
a processed image; and 

(d) evaluate the processed image for a visible indication of an improved spatial 
distribution of color. 
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